2023-02-17 18:01:03,930 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-17 18:01:03,970 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=167, AvailableMemoryMB=9355 2023-02-17 18:01:04,232 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260 2023-02-17 18:01:04,239 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 18:01:04,240 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/cluster_9efdca55-750a-e438-a008-db661fd2107e, deleteOnExit=true 2023-02-17 18:01:04,240 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 18:01:04,240 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/test.cache.data in system properties and HBase conf 2023-02-17 18:01:04,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 18:01:04,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/hadoop.log.dir in system properties and HBase conf 2023-02-17 18:01:04,242 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 18:01:04,242 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 18:01:04,242 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 18:01:04,339 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-17 18:01:04,756 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 18:01:04,760 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:04,760 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:04,760 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 18:01:04,761 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:04,761 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 18:01:04,761 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 18:01:04,762 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:04,762 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:04,762 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 18:01:04,762 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/nfs.dump.dir in system properties and HBase conf 2023-02-17 18:01:04,763 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/java.io.tmpdir in system properties and HBase conf 2023-02-17 18:01:04,763 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:04,763 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 18:01:04,763 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 18:01:05,201 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:05,205 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:05,471 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-17 18:01:05,636 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-17 18:01:05,647 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:05,687 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:05,724 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/java.io.tmpdir/Jetty_localhost_32769_hdfs____.gozizf/webapp 2023-02-17 18:01:05,868 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32769 2023-02-17 18:01:05,880 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:05,880 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:06,429 WARN [Listener at localhost/37141] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:06,501 WARN [Listener at localhost/37141] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:06,524 WARN [Listener at localhost/37141] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:06,531 INFO [Listener at localhost/37141] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:06,537 INFO [Listener at localhost/37141] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/java.io.tmpdir/Jetty_localhost_35435_datanode____.12och1/webapp 2023-02-17 18:01:06,649 INFO [Listener at localhost/37141] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35435 2023-02-17 18:01:07,089 WARN [Listener at localhost/37551] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:07,153 WARN [Listener at localhost/37551] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:07,158 WARN [Listener at localhost/37551] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:07,159 INFO [Listener at localhost/37551] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:07,164 INFO [Listener at localhost/37551] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/java.io.tmpdir/Jetty_localhost_35563_datanode____8h9drr/webapp 2023-02-17 18:01:07,278 INFO [Listener at localhost/37551] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35563 2023-02-17 18:01:07,291 WARN [Listener at localhost/36077] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:07,648 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf9369f4d92a6168c: Processing first storage report for DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5 from datanode 1906d1db-c234-4cd6-9d29-b595b9160654 2023-02-17 18:01:07,650 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf9369f4d92a6168c: from storage DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5 node DatanodeRegistration(127.0.0.1:40737, datanodeUuid=1906d1db-c234-4cd6-9d29-b595b9160654, infoPort=44519, infoSecurePort=0, ipcPort=37551, storageInfo=lv=-57;cid=testClusterID;nsid=787966984;c=1676656865269), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-17 18:01:07,650 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x59fc94c5c3fc5d97: Processing first storage report for DS-53b3e756-c525-407c-8dcb-5b63df590d3b from datanode 5a5ae37c-0c91-41fc-a727-b76b3232c967 2023-02-17 18:01:07,651 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x59fc94c5c3fc5d97: from storage DS-53b3e756-c525-407c-8dcb-5b63df590d3b node DatanodeRegistration(127.0.0.1:41291, datanodeUuid=5a5ae37c-0c91-41fc-a727-b76b3232c967, infoPort=46275, infoSecurePort=0, ipcPort=36077, storageInfo=lv=-57;cid=testClusterID;nsid=787966984;c=1676656865269), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:07,651 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf9369f4d92a6168c: Processing first storage report for DS-7ac9ac67-e445-4d7a-a1ec-a072e2620579 from datanode 1906d1db-c234-4cd6-9d29-b595b9160654 2023-02-17 18:01:07,651 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf9369f4d92a6168c: from storage DS-7ac9ac67-e445-4d7a-a1ec-a072e2620579 node DatanodeRegistration(127.0.0.1:40737, datanodeUuid=1906d1db-c234-4cd6-9d29-b595b9160654, infoPort=44519, infoSecurePort=0, ipcPort=37551, storageInfo=lv=-57;cid=testClusterID;nsid=787966984;c=1676656865269), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:07,651 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x59fc94c5c3fc5d97: Processing first storage report for DS-c074b66f-4424-4986-9bf9-c2bd33f7ff17 from datanode 5a5ae37c-0c91-41fc-a727-b76b3232c967 2023-02-17 18:01:07,651 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x59fc94c5c3fc5d97: from storage DS-c074b66f-4424-4986-9bf9-c2bd33f7ff17 node DatanodeRegistration(127.0.0.1:41291, datanodeUuid=5a5ae37c-0c91-41fc-a727-b76b3232c967, infoPort=46275, infoSecurePort=0, ipcPort=36077, storageInfo=lv=-57;cid=testClusterID;nsid=787966984;c=1676656865269), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:07,726 DEBUG [Listener at localhost/36077] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260 2023-02-17 18:01:07,817 INFO [Listener at localhost/36077] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/cluster_9efdca55-750a-e438-a008-db661fd2107e/zookeeper_0, clientPort=54341, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/cluster_9efdca55-750a-e438-a008-db661fd2107e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/cluster_9efdca55-750a-e438-a008-db661fd2107e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 18:01:07,839 INFO [Listener at localhost/36077] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54341 2023-02-17 18:01:07,850 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:07,854 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:08,512 INFO [Listener at localhost/36077] util.FSUtils(479): Created version file at hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8 with version=8 2023-02-17 18:01:08,513 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:08,516 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:08,524 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/hbase-staging 2023-02-17 18:01:08,905 INFO [Listener at localhost/36077] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-17 18:01:09,365 INFO [Listener at localhost/36077] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:09,403 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:09,404 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:09,404 INFO [Listener at localhost/36077] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:09,404 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:09,404 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:09,547 INFO [Listener at localhost/36077] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:09,617 DEBUG [Listener at localhost/36077] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-17 18:01:09,711 INFO [Listener at localhost/36077] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39369 2023-02-17 18:01:09,721 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:09,724 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:09,746 INFO [Listener at localhost/36077] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39369 connecting to ZooKeeper ensemble=127.0.0.1:54341 2023-02-17 18:01:09,795 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:393690x0, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:09,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39369-0x100637163930000 connected 2023-02-17 18:01:09,825 DEBUG [Listener at localhost/36077] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:09,826 DEBUG [Listener at localhost/36077] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:09,829 DEBUG [Listener at localhost/36077] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:09,837 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39369 2023-02-17 18:01:09,837 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39369 2023-02-17 18:01:09,838 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39369 2023-02-17 18:01:09,838 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39369 2023-02-17 18:01:09,839 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39369 2023-02-17 18:01:09,846 INFO [Listener at localhost/36077] master.HMaster(444): hbase.rootdir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8, hbase.cluster.distributed=false 2023-02-17 18:01:09,915 INFO [Listener at localhost/36077] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:09,916 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:09,916 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:09,916 INFO [Listener at localhost/36077] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:09,916 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:09,917 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:09,922 INFO [Listener at localhost/36077] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:09,925 INFO [Listener at localhost/36077] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40417 2023-02-17 18:01:09,927 INFO [Listener at localhost/36077] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:09,935 DEBUG [Listener at localhost/36077] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:09,936 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:09,939 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:09,941 INFO [Listener at localhost/36077] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40417 connecting to ZooKeeper ensemble=127.0.0.1:54341 2023-02-17 18:01:09,946 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:404170x0, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:09,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40417-0x100637163930001 connected 2023-02-17 18:01:09,947 DEBUG [Listener at localhost/36077] zookeeper.ZKUtil(164): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:09,948 DEBUG [Listener at localhost/36077] zookeeper.ZKUtil(164): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:09,949 DEBUG [Listener at localhost/36077] zookeeper.ZKUtil(164): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:09,949 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40417 2023-02-17 18:01:09,950 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40417 2023-02-17 18:01:09,950 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40417 2023-02-17 18:01:09,952 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40417 2023-02-17 18:01:09,952 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40417 2023-02-17 18:01:09,964 INFO [Listener at localhost/36077] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:09,964 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:09,964 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:09,965 INFO [Listener at localhost/36077] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:09,965 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:09,965 INFO [Listener at localhost/36077] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:09,965 INFO [Listener at localhost/36077] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:09,967 INFO [Listener at localhost/36077] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40351 2023-02-17 18:01:09,967 INFO [Listener at localhost/36077] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:09,968 DEBUG [Listener at localhost/36077] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:09,969 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:09,971 INFO [Listener at localhost/36077] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:09,973 INFO [Listener at localhost/36077] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40351 connecting to ZooKeeper ensemble=127.0.0.1:54341 2023-02-17 18:01:09,978 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:403510x0, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:09,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40351-0x100637163930002 connected 2023-02-17 18:01:09,980 DEBUG [Listener at localhost/36077] zookeeper.ZKUtil(164): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:09,981 DEBUG [Listener at localhost/36077] zookeeper.ZKUtil(164): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:09,981 DEBUG [Listener at localhost/36077] zookeeper.ZKUtil(164): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:09,984 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40351 2023-02-17 18:01:09,984 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40351 2023-02-17 18:01:09,988 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40351 2023-02-17 18:01:09,988 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40351 2023-02-17 18:01:09,988 DEBUG [Listener at localhost/36077] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40351 2023-02-17 18:01:09,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:09,999 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:10,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:10,020 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:10,020 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:10,020 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:10,021 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:10,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:10,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39369,1676656868739 from backup master directory 2023-02-17 18:01:10,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:10,028 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:10,028 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:10,029 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:10,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:10,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-17 18:01:10,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-17 18:01:10,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/hbase.id with ID: 35a0183a-f331-49bd-9af2-7cd45f4eead9 2023-02-17 18:01:10,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:10,176 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:10,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2674ff2b to 127.0.0.1:54341 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:10,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d126a51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:10,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:10,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 18:01:10,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-17 18:01:10,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-17 18:01:10,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-17 18:01:10,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-17 18:01:10,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:10,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/data/master/store-tmp 2023-02-17 18:01:10,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:10,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:10,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:10,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:10,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:10,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:10,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:10,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:10,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/WALs/jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:10,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39369%2C1676656868739, suffix=, logDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/WALs/jenkins-hbase4.apache.org,39369,1676656868739, archiveDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/oldWALs, maxLogs=10 2023-02-17 18:01:10,466 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40737,DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5,DISK] 2023-02-17 18:01:10,466 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41291,DS-53b3e756-c525-407c-8dcb-5b63df590d3b,DISK] 2023-02-17 18:01:10,474 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-17 18:01:10,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/WALs/jenkins-hbase4.apache.org,39369,1676656868739/jenkins-hbase4.apache.org%2C39369%2C1676656868739.1676656870417 2023-02-17 18:01:10,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41291,DS-53b3e756-c525-407c-8dcb-5b63df590d3b,DISK], DatanodeInfoWithStorage[127.0.0.1:40737,DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5,DISK]] 2023-02-17 18:01:10,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:10,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:10,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:10,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:10,614 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:10,621 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 18:01:10,653 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 18:01:10,669 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:10,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:10,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:10,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:10,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:10,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68545080, jitterRate=0.021401286125183105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:10,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:10,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 18:01:10,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 18:01:10,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 18:01:10,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 18:01:10,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-17 18:01:10,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-17 18:01:10,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 18:01:10,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 18:01:10,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 18:01:10,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 18:01:10,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 18:01:10,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 18:01:10,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 18:01:10,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 18:01:10,842 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:10,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 18:01:10,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 18:01:10,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 18:01:10,868 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:10,868 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:10,868 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:10,868 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:10,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39369,1676656868739, sessionid=0x100637163930000, setting cluster-up flag (Was=false) 2023-02-17 18:01:10,892 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:10,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 18:01:10,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:10,912 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:10,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 18:01:10,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:10,928 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.hbase-snapshot/.tmp 2023-02-17 18:01:10,993 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(952): ClusterId : 35a0183a-f331-49bd-9af2-7cd45f4eead9 2023-02-17 18:01:10,994 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(952): ClusterId : 35a0183a-f331-49bd-9af2-7cd45f4eead9 2023-02-17 18:01:10,999 DEBUG [RS:0;jenkins-hbase4:40417] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:10,999 DEBUG [RS:1;jenkins-hbase4:40351] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:11,007 DEBUG [RS:0;jenkins-hbase4:40417] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:11,007 DEBUG [RS:1;jenkins-hbase4:40351] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:11,007 DEBUG [RS:0;jenkins-hbase4:40417] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:11,007 DEBUG [RS:1;jenkins-hbase4:40351] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:11,011 DEBUG [RS:0;jenkins-hbase4:40417] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:11,012 DEBUG [RS:1;jenkins-hbase4:40351] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:11,012 DEBUG [RS:0;jenkins-hbase4:40417] zookeeper.ReadOnlyZKClient(139): Connect 0x6c3c26a2 to 127.0.0.1:54341 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:11,013 DEBUG [RS:1;jenkins-hbase4:40351] zookeeper.ReadOnlyZKClient(139): Connect 0x6bb3a543 to 127.0.0.1:54341 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:11,020 DEBUG [RS:0;jenkins-hbase4:40417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dfc1e62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:11,021 DEBUG [RS:0;jenkins-hbase4:40417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72121d1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:11,021 DEBUG [RS:1;jenkins-hbase4:40351] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65745645, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:11,021 DEBUG [RS:1;jenkins-hbase4:40351] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@614bce33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:11,042 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40417 2023-02-17 18:01:11,044 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40351 2023-02-17 18:01:11,048 INFO [RS:0;jenkins-hbase4:40417] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:11,048 INFO [RS:1;jenkins-hbase4:40351] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:11,048 INFO [RS:0;jenkins-hbase4:40417] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:11,048 INFO [RS:1;jenkins-hbase4:40351] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:11,048 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:11,048 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:11,051 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39369,1676656868739 with isa=jenkins-hbase4.apache.org/172.31.14.131:40417, startcode=1676656869914 2023-02-17 18:01:11,051 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39369,1676656868739 with isa=jenkins-hbase4.apache.org/172.31.14.131:40351, startcode=1676656869964 2023-02-17 18:01:11,069 DEBUG [RS:1;jenkins-hbase4:40351] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:11,069 DEBUG [RS:0;jenkins-hbase4:40417] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:11,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:11,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:11,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:11,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:11,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:11,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 18:01:11,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:11,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:11,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:11,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676656901105 2023-02-17 18:01:11,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 18:01:11,112 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:11,113 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 18:01:11,118 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:11,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 18:01:11,126 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56257, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:11,126 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42425, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:11,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 18:01:11,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 18:01:11,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 18:01:11,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 18:01:11,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:11,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 18:01:11,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39369] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 18:01:11,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 18:01:11,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 18:01:11,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 18:01:11,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 18:01:11,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 18:01:11,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656871148,5,FailOnTimeoutGroup] 2023-02-17 18:01:11,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656871153,5,FailOnTimeoutGroup] 2023-02-17 18:01:11,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:11,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 18:01:11,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:11,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:11,168 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:11,169 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:11,169 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8 2023-02-17 18:01:11,182 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(2829): Master is not running yet 2023-02-17 18:01:11,182 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(2829): Master is not running yet 2023-02-17 18:01:11,183 WARN [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-17 18:01:11,183 WARN [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-17 18:01:11,188 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:11,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:11,193 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/info 2023-02-17 18:01:11,194 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:11,195 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:11,195 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:11,198 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:11,198 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:11,199 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:11,199 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:11,201 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/table 2023-02-17 18:01:11,202 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:11,203 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:11,204 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740 2023-02-17 18:01:11,205 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740 2023-02-17 18:01:11,209 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:11,211 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:11,215 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:11,217 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67083314, jitterRate=-3.807246685028076E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:11,217 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:11,217 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:11,217 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:11,217 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:11,217 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:11,217 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:11,218 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:11,218 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:11,223 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:11,223 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 18:01:11,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 18:01:11,243 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 18:01:11,246 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 18:01:11,396 WARN [jenkins-hbase4:39369] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-17 18:01:12,184 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39369,1676656868739 with isa=jenkins-hbase4.apache.org/172.31.14.131:40417, startcode=1676656869914 2023-02-17 18:01:12,184 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39369,1676656868739 with isa=jenkins-hbase4.apache.org/172.31.14.131:40351, startcode=1676656869964 2023-02-17 18:01:12,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:12,192 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39369] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:12,202 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8 2023-02-17 18:01:12,202 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8 2023-02-17 18:01:12,202 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37141 2023-02-17 18:01:12,202 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37141 2023-02-17 18:01:12,202 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:12,202 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:12,214 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:12,215 DEBUG [RS:1;jenkins-hbase4:40351] zookeeper.ZKUtil(162): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:12,215 DEBUG [RS:0;jenkins-hbase4:40417] zookeeper.ZKUtil(162): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:12,216 WARN [RS:1;jenkins-hbase4:40351] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:12,216 INFO [RS:1;jenkins-hbase4:40351] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:12,216 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/WALs/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:12,216 WARN [RS:0;jenkins-hbase4:40417] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:12,232 INFO [RS:0;jenkins-hbase4:40417] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:12,232 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/WALs/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:12,233 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40351,1676656869964] 2023-02-17 18:01:12,233 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40417,1676656869914] 2023-02-17 18:01:12,250 DEBUG [RS:1;jenkins-hbase4:40351] zookeeper.ZKUtil(162): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:12,250 DEBUG [RS:0;jenkins-hbase4:40417] zookeeper.ZKUtil(162): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:12,250 DEBUG [RS:1;jenkins-hbase4:40351] zookeeper.ZKUtil(162): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:12,250 DEBUG [RS:0;jenkins-hbase4:40417] zookeeper.ZKUtil(162): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:12,261 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:12,261 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:12,272 INFO [RS:0;jenkins-hbase4:40417] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:12,272 INFO [RS:1;jenkins-hbase4:40351] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:12,294 INFO [RS:1;jenkins-hbase4:40351] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:12,294 INFO [RS:0;jenkins-hbase4:40417] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:12,298 INFO [RS:1;jenkins-hbase4:40351] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:12,298 INFO [RS:0;jenkins-hbase4:40417] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:12,299 INFO [RS:1;jenkins-hbase4:40351] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,299 INFO [RS:0;jenkins-hbase4:40417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,300 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:12,300 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:12,309 INFO [RS:1;jenkins-hbase4:40351] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,309 INFO [RS:0;jenkins-hbase4:40417] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,309 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,309 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,309 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:12,310 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:12,310 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,310 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,311 DEBUG [RS:1;jenkins-hbase4:40351] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,311 DEBUG [RS:0;jenkins-hbase4:40417] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:12,316 INFO [RS:1;jenkins-hbase4:40351] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,316 INFO [RS:1;jenkins-hbase4:40351] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,316 INFO [RS:0;jenkins-hbase4:40417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,316 INFO [RS:1;jenkins-hbase4:40351] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,317 INFO [RS:0;jenkins-hbase4:40417] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,317 INFO [RS:0;jenkins-hbase4:40417] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,333 INFO [RS:0;jenkins-hbase4:40417] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:12,333 INFO [RS:1;jenkins-hbase4:40351] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:12,337 INFO [RS:0;jenkins-hbase4:40417] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40417,1676656869914-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,337 INFO [RS:1;jenkins-hbase4:40351] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40351,1676656869964-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,364 INFO [RS:0;jenkins-hbase4:40417] regionserver.Replication(203): jenkins-hbase4.apache.org,40417,1676656869914 started 2023-02-17 18:01:12,364 INFO [RS:1;jenkins-hbase4:40351] regionserver.Replication(203): jenkins-hbase4.apache.org,40351,1676656869964 started 2023-02-17 18:01:12,364 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40417,1676656869914, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40417, sessionid=0x100637163930001 2023-02-17 18:01:12,364 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40351,1676656869964, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40351, sessionid=0x100637163930002 2023-02-17 18:01:12,364 DEBUG [RS:0;jenkins-hbase4:40417] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:12,364 DEBUG [RS:1;jenkins-hbase4:40351] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:12,365 DEBUG [RS:0;jenkins-hbase4:40417] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:12,365 DEBUG [RS:1;jenkins-hbase4:40351] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:12,365 DEBUG [RS:0;jenkins-hbase4:40417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40417,1676656869914' 2023-02-17 18:01:12,365 DEBUG [RS:1;jenkins-hbase4:40351] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40351,1676656869964' 2023-02-17 18:01:12,366 DEBUG [RS:1;jenkins-hbase4:40351] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:12,366 DEBUG [RS:0;jenkins-hbase4:40417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:12,367 DEBUG [RS:0;jenkins-hbase4:40417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:12,367 DEBUG [RS:1;jenkins-hbase4:40351] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:12,367 DEBUG [RS:1;jenkins-hbase4:40351] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:12,367 DEBUG [RS:0;jenkins-hbase4:40417] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:12,367 DEBUG [RS:1;jenkins-hbase4:40351] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:12,367 DEBUG [RS:0;jenkins-hbase4:40417] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:12,367 DEBUG [RS:1;jenkins-hbase4:40351] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:12,368 DEBUG [RS:0;jenkins-hbase4:40417] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:12,368 DEBUG [RS:0;jenkins-hbase4:40417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40417,1676656869914' 2023-02-17 18:01:12,368 DEBUG [RS:1;jenkins-hbase4:40351] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40351,1676656869964' 2023-02-17 18:01:12,368 DEBUG [RS:0;jenkins-hbase4:40417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:12,368 DEBUG [RS:1;jenkins-hbase4:40351] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:12,369 DEBUG [RS:0;jenkins-hbase4:40417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:12,369 DEBUG [RS:1;jenkins-hbase4:40351] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:12,369 DEBUG [RS:0;jenkins-hbase4:40417] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:12,369 INFO [RS:0;jenkins-hbase4:40417] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:12,370 INFO [RS:0;jenkins-hbase4:40417] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:12,370 DEBUG [RS:1;jenkins-hbase4:40351] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:12,370 INFO [RS:1;jenkins-hbase4:40351] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:12,370 INFO [RS:1;jenkins-hbase4:40351] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:12,399 DEBUG [jenkins-hbase4:39369] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 18:01:12,405 DEBUG [jenkins-hbase4:39369] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:12,412 DEBUG [jenkins-hbase4:39369] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:12,412 DEBUG [jenkins-hbase4:39369] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:12,412 DEBUG [jenkins-hbase4:39369] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:12,415 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40417,1676656869914, state=OPENING 2023-02-17 18:01:12,422 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 18:01:12,426 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:12,427 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:12,431 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:12,616 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:12,618 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:12,622 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:12,637 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 18:01:12,638 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:12,641 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40417%2C1676656869914.meta, suffix=.meta, logDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/WALs/jenkins-hbase4.apache.org,40417,1676656869914, archiveDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/oldWALs, maxLogs=32 2023-02-17 18:01:12,662 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40737,DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5,DISK] 2023-02-17 18:01:12,662 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41291,DS-53b3e756-c525-407c-8dcb-5b63df590d3b,DISK] 2023-02-17 18:01:12,667 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/WALs/jenkins-hbase4.apache.org,40417,1676656869914/jenkins-hbase4.apache.org%2C40417%2C1676656869914.meta.1676656872644.meta 2023-02-17 18:01:12,667 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40737,DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5,DISK], DatanodeInfoWithStorage[127.0.0.1:41291,DS-53b3e756-c525-407c-8dcb-5b63df590d3b,DISK]] 2023-02-17 18:01:12,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:12,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 18:01:12,686 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 18:01:12,691 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 18:01:12,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 18:01:12,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:12,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 18:01:12,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 18:01:12,701 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:12,703 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/info 2023-02-17 18:01:12,703 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/info 2023-02-17 18:01:12,704 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:12,705 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:12,705 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:12,707 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:12,707 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:12,708 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:12,709 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:12,709 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:12,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/table 2023-02-17 18:01:12,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/table 2023-02-17 18:01:12,711 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:12,712 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:12,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740 2023-02-17 18:01:12,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740 2023-02-17 18:01:12,734 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:12,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:12,738 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60187750, jitterRate=-0.10313263535499573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:12,738 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:12,754 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676656872608 2023-02-17 18:01:12,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 18:01:12,778 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 18:01:12,778 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40417,1676656869914, state=OPEN 2023-02-17 18:01:12,781 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 18:01:12,782 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:12,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 18:01:12,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40417,1676656869914 in 351 msec 2023-02-17 18:01:12,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 18:01:12,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5550 sec 2023-02-17 18:01:12,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.7980 sec 2023-02-17 18:01:12,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676656872797, completionTime=-1 2023-02-17 18:01:12,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 18:01:12,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 18:01:12,864 DEBUG [hconnection-0x19701f0f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:12,868 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53094, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:12,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 18:01:12,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676656932887 2023-02-17 18:01:12,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676656992887 2023-02-17 18:01:12,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 88 msec 2023-02-17 18:01:12,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39369,1676656868739-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39369,1676656868739-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39369,1676656868739-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39369, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:12,921 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 18:01:12,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 18:01:12,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:12,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 18:01:12,947 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:12,951 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:12,975 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/hbase/namespace/d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:12,978 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/hbase/namespace/d012c65f939b7533387d7b159f66664b empty. 2023-02-17 18:01:12,979 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/hbase/namespace/d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:12,980 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 18:01:13,011 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:13,013 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d012c65f939b7533387d7b159f66664b, NAME => 'hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:13,032 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:13,032 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d012c65f939b7533387d7b159f66664b, disabling compactions & flushes 2023-02-17 18:01:13,032 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:13,032 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:13,032 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. after waiting 0 ms 2023-02-17 18:01:13,032 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:13,032 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:13,033 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d012c65f939b7533387d7b159f66664b: 2023-02-17 18:01:13,037 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:13,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656873040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656873040"}]},"ts":"1676656873040"} 2023-02-17 18:01:13,080 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:13,082 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:13,087 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656873083"}]},"ts":"1676656873083"} 2023-02-17 18:01:13,092 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 18:01:13,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:13,099 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:13,099 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:13,099 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:13,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d012c65f939b7533387d7b159f66664b, ASSIGN}] 2023-02-17 18:01:13,104 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d012c65f939b7533387d7b159f66664b, ASSIGN 2023-02-17 18:01:13,107 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d012c65f939b7533387d7b159f66664b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40351,1676656869964; forceNewPlan=false, retain=false 2023-02-17 18:01:13,259 INFO [jenkins-hbase4:39369] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:13,260 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d012c65f939b7533387d7b159f66664b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:13,261 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656873260"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656873260"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656873260"}]},"ts":"1676656873260"} 2023-02-17 18:01:13,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d012c65f939b7533387d7b159f66664b, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:13,380 INFO [RS:1;jenkins-hbase4:40351] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40351%2C1676656869964, suffix=, logDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/WALs/jenkins-hbase4.apache.org,40351,1676656869964, archiveDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/oldWALs, maxLogs=32 2023-02-17 18:01:13,380 INFO [RS:0;jenkins-hbase4:40417] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40417%2C1676656869914, suffix=, logDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/WALs/jenkins-hbase4.apache.org,40417,1676656869914, archiveDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/oldWALs, maxLogs=32 2023-02-17 18:01:13,402 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41291,DS-53b3e756-c525-407c-8dcb-5b63df590d3b,DISK] 2023-02-17 18:01:13,403 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40737,DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5,DISK] 2023-02-17 18:01:13,403 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40737,DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5,DISK] 2023-02-17 18:01:13,403 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41291,DS-53b3e756-c525-407c-8dcb-5b63df590d3b,DISK] 2023-02-17 18:01:13,408 INFO [RS:0;jenkins-hbase4:40417] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/WALs/jenkins-hbase4.apache.org,40417,1676656869914/jenkins-hbase4.apache.org%2C40417%2C1676656869914.1676656873383 2023-02-17 18:01:13,409 DEBUG [RS:0;jenkins-hbase4:40417] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41291,DS-53b3e756-c525-407c-8dcb-5b63df590d3b,DISK], DatanodeInfoWithStorage[127.0.0.1:40737,DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5,DISK]] 2023-02-17 18:01:13,409 INFO [RS:1;jenkins-hbase4:40351] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/WALs/jenkins-hbase4.apache.org,40351,1676656869964/jenkins-hbase4.apache.org%2C40351%2C1676656869964.1676656873383 2023-02-17 18:01:13,409 DEBUG [RS:1;jenkins-hbase4:40351] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40737,DS-ed67fe48-f9cd-4ad9-9c6f-5d2ad2da45a5,DISK], DatanodeInfoWithStorage[127.0.0.1:41291,DS-53b3e756-c525-407c-8dcb-5b63df590d3b,DISK]] 2023-02-17 18:01:13,423 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:13,424 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:13,427 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34010, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:13,450 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:13,450 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d012c65f939b7533387d7b159f66664b, NAME => 'hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:13,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:13,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:13,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:13,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:13,456 INFO [StoreOpener-d012c65f939b7533387d7b159f66664b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:13,458 DEBUG [StoreOpener-d012c65f939b7533387d7b159f66664b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b/info 2023-02-17 18:01:13,458 DEBUG [StoreOpener-d012c65f939b7533387d7b159f66664b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b/info 2023-02-17 18:01:13,459 INFO [StoreOpener-d012c65f939b7533387d7b159f66664b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d012c65f939b7533387d7b159f66664b columnFamilyName info 2023-02-17 18:01:13,460 INFO [StoreOpener-d012c65f939b7533387d7b159f66664b-1] regionserver.HStore(310): Store=d012c65f939b7533387d7b159f66664b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:13,462 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:13,463 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:13,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:13,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:13,474 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d012c65f939b7533387d7b159f66664b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68947909, jitterRate=0.027403905987739563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:13,474 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d012c65f939b7533387d7b159f66664b: 2023-02-17 18:01:13,476 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b., pid=6, masterSystemTime=1676656873423 2023-02-17 18:01:13,482 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:13,482 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:13,484 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d012c65f939b7533387d7b159f66664b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:13,484 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656873483"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656873483"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656873483"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656873483"}]},"ts":"1676656873483"} 2023-02-17 18:01:13,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 18:01:13,500 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d012c65f939b7533387d7b159f66664b, server=jenkins-hbase4.apache.org,40351,1676656869964 in 226 msec 2023-02-17 18:01:13,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 18:01:13,506 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d012c65f939b7533387d7b159f66664b, ASSIGN in 398 msec 2023-02-17 18:01:13,507 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:13,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656873508"}]},"ts":"1676656873508"} 2023-02-17 18:01:13,514 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 18:01:13,517 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:13,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 585 msec 2023-02-17 18:01:13,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 18:01:13,548 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:13,548 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:13,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:13,573 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:13,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 18:01:13,606 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:13,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-02-17 18:01:13,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 18:01:13,646 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:13,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 32 msec 2023-02-17 18:01:13,683 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 18:01:13,685 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 18:01:13,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.656sec 2023-02-17 18:01:13,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 18:01:13,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 18:01:13,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 18:01:13,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39369,1676656868739-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 18:01:13,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39369,1676656868739-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 18:01:13,702 DEBUG [Listener at localhost/36077] zookeeper.ReadOnlyZKClient(139): Connect 0x5baee36d to 127.0.0.1:54341 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:13,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 18:01:13,707 DEBUG [Listener at localhost/36077] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a5e66b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:13,751 DEBUG [hconnection-0x18108b09-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:13,762 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52666, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:13,775 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:13,776 DEBUG [Listener at localhost/36077] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 18:01:13,788 DEBUG [Listener at localhost/36077] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 18:01:13,791 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 18:01:13,796 INFO [Listener at localhost/36077] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 18:01:13,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 18:01:13,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 18:01:13,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:49778 deadline: 1676656933799, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-17 18:01:13,803 INFO [Listener at localhost/36077] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-17 18:01:13,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:13,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-17 18:01:13,820 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:13,823 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:13,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-17 18:01:13,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:13,845 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:13,845 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178 2023-02-17 18:01:13,845 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:13,845 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306 2023-02-17 18:01:13,845 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:13,845 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:13,845 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:13,845 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:13,846 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0 empty. 2023-02-17 18:01:13,846 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2 empty. 2023-02-17 18:01:13,846 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306 empty. 2023-02-17 18:01:13,846 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c empty. 2023-02-17 18:01:13,848 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317 empty. 2023-02-17 18:01:13,848 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:13,848 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:13,849 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da empty. 2023-02-17 18:01:13,848 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:13,848 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178 empty. 2023-02-17 18:01:13,849 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:13,849 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:13,849 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306 2023-02-17 18:01:13,848 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0 empty. 2023-02-17 18:01:13,849 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:13,850 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2 empty. 2023-02-17 18:01:13,850 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:13,850 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178 2023-02-17 18:01:13,850 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c empty. 2023-02-17 18:01:13,851 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:13,851 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:13,851 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:13,851 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 18:01:13,871 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:13,873 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 34459a93abdbe75d8f607201b16b0317, NAME => 'testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:13,874 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ed443a661d7e295cf386652efe912178, NAME => 'testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:13,874 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => df7397fff874739e2928157f9cc3d2a0, NAME => 'testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:13,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:13,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:13,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 34459a93abdbe75d8f607201b16b0317, disabling compactions & flushes 2023-02-17 18:01:13,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing df7397fff874739e2928157f9cc3d2a0, disabling compactions & flushes 2023-02-17 18:01:13,946 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:13,946 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:13,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:13,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:13,946 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. after waiting 0 ms 2023-02-17 18:01:13,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. after waiting 0 ms 2023-02-17 18:01:13,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:13,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:13,947 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:13,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:13,947 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:13,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for df7397fff874739e2928157f9cc3d2a0: 2023-02-17 18:01:13,947 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 34459a93abdbe75d8f607201b16b0317: 2023-02-17 18:01:13,949 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 96b58084280324f52a9759d84ee12306, NAME => 'testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:13,949 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4bed7d34e697192bd3b7561af0bb94e2, NAME => 'testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:13,950 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:13,950 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ed443a661d7e295cf386652efe912178, disabling compactions & flushes 2023-02-17 18:01:13,951 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:13,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:13,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. after waiting 0 ms 2023-02-17 18:01:13,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:13,951 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:13,951 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ed443a661d7e295cf386652efe912178: 2023-02-17 18:01:13,951 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 668b8c0def8ac669c2322b0032ccb53c, NAME => 'testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:13,991 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:13,991 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 668b8c0def8ac669c2322b0032ccb53c, disabling compactions & flushes 2023-02-17 18:01:13,991 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:13,991 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:13,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. after waiting 0 ms 2023-02-17 18:01:13,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:13,992 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:13,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 668b8c0def8ac669c2322b0032ccb53c: 2023-02-17 18:01:13,993 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6774bd4b3819baff6ad609f7188c1ad0, NAME => 'testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:13,994 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:13,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4bed7d34e697192bd3b7561af0bb94e2, disabling compactions & flushes 2023-02-17 18:01:13,995 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:13,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:13,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. after waiting 0 ms 2023-02-17 18:01:13,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:13,995 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:13,995 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4bed7d34e697192bd3b7561af0bb94e2: 2023-02-17 18:01:13,996 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e2c3d4afab922c1be50962ad98bc41da, NAME => 'testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:14,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e2c3d4afab922c1be50962ad98bc41da, disabling compactions & flushes 2023-02-17 18:01:14,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:14,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:14,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. after waiting 0 ms 2023-02-17 18:01:14,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:14,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6774bd4b3819baff6ad609f7188c1ad0, disabling compactions & flushes 2023-02-17 18:01:14,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:14,022 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:14,022 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e2c3d4afab922c1be50962ad98bc41da: 2023-02-17 18:01:14,022 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:14,022 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. after waiting 0 ms 2023-02-17 18:01:14,022 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:14,022 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c5494d2cbfab0772cd8ed47e2da3b4b2, NAME => 'testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:14,022 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:14,022 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6774bd4b3819baff6ad609f7188c1ad0: 2023-02-17 18:01:14,023 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f3e1b299e5de21dbb1cd167717a4fd6c, NAME => 'testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp 2023-02-17 18:01:14,054 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,054 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c5494d2cbfab0772cd8ed47e2da3b4b2, disabling compactions & flushes 2023-02-17 18:01:14,054 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:14,054 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:14,054 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. after waiting 0 ms 2023-02-17 18:01:14,055 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:14,055 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:14,055 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c5494d2cbfab0772cd8ed47e2da3b4b2: 2023-02-17 18:01:14,057 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f3e1b299e5de21dbb1cd167717a4fd6c, disabling compactions & flushes 2023-02-17 18:01:14,058 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:14,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:14,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. after waiting 0 ms 2023-02-17 18:01:14,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:14,059 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:14,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f3e1b299e5de21dbb1cd167717a4fd6c: 2023-02-17 18:01:14,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:14,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 96b58084280324f52a9759d84ee12306, disabling compactions & flushes 2023-02-17 18:01:14,393 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:14,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:14,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. after waiting 0 ms 2023-02-17 18:01:14,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:14,393 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:14,393 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 96b58084280324f52a9759d84ee12306: 2023-02-17 18:01:14,398 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:14,400 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,400 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,402 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676656873810.96b58084280324f52a9759d84ee12306.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874400"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656874400"}]},"ts":"1676656874400"} 2023-02-17 18:01:14,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:14,455 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-17 18:01:14,457 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:14,457 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656874457"}]},"ts":"1676656874457"} 2023-02-17 18:01:14,460 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-17 18:01:14,464 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:14,476 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:14,476 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:14,476 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:14,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=df7397fff874739e2928157f9cc3d2a0, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ed443a661d7e295cf386652efe912178, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=34459a93abdbe75d8f607201b16b0317, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=96b58084280324f52a9759d84ee12306, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4bed7d34e697192bd3b7561af0bb94e2, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=668b8c0def8ac669c2322b0032ccb53c, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6774bd4b3819baff6ad609f7188c1ad0, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2c3d4afab922c1be50962ad98bc41da, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c5494d2cbfab0772cd8ed47e2da3b4b2, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f3e1b299e5de21dbb1cd167717a4fd6c, ASSIGN}] 2023-02-17 18:01:14,481 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ed443a661d7e295cf386652efe912178, ASSIGN 2023-02-17 18:01:14,481 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=df7397fff874739e2928157f9cc3d2a0, ASSIGN 2023-02-17 18:01:14,482 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=34459a93abdbe75d8f607201b16b0317, ASSIGN 2023-02-17 18:01:14,483 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f3e1b299e5de21dbb1cd167717a4fd6c, ASSIGN 2023-02-17 18:01:14,483 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ed443a661d7e295cf386652efe912178, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40351,1676656869964; forceNewPlan=false, retain=false 2023-02-17 18:01:14,485 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=df7397fff874739e2928157f9cc3d2a0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40351,1676656869964; forceNewPlan=false, retain=false 2023-02-17 18:01:14,485 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=34459a93abdbe75d8f607201b16b0317, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40417,1676656869914; forceNewPlan=false, retain=false 2023-02-17 18:01:14,485 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c5494d2cbfab0772cd8ed47e2da3b4b2, ASSIGN 2023-02-17 18:01:14,485 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f3e1b299e5de21dbb1cd167717a4fd6c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40351,1676656869964; forceNewPlan=false, retain=false 2023-02-17 18:01:14,486 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e2c3d4afab922c1be50962ad98bc41da, ASSIGN 2023-02-17 18:01:14,486 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6774bd4b3819baff6ad609f7188c1ad0, ASSIGN 2023-02-17 18:01:14,487 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c5494d2cbfab0772cd8ed47e2da3b4b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40417,1676656869914; forceNewPlan=false, retain=false 2023-02-17 18:01:14,487 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=668b8c0def8ac669c2322b0032ccb53c, ASSIGN 2023-02-17 18:01:14,487 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4bed7d34e697192bd3b7561af0bb94e2, ASSIGN 2023-02-17 18:01:14,488 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6774bd4b3819baff6ad609f7188c1ad0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40351,1676656869964; forceNewPlan=false, retain=false 2023-02-17 18:01:14,488 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e2c3d4afab922c1be50962ad98bc41da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40417,1676656869914; forceNewPlan=false, retain=false 2023-02-17 18:01:14,489 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=96b58084280324f52a9759d84ee12306, ASSIGN 2023-02-17 18:01:14,489 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=668b8c0def8ac669c2322b0032ccb53c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40417,1676656869914; forceNewPlan=false, retain=false 2023-02-17 18:01:14,489 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4bed7d34e697192bd3b7561af0bb94e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40351,1676656869964; forceNewPlan=false, retain=false 2023-02-17 18:01:14,491 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=96b58084280324f52a9759d84ee12306, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40417,1676656869914; forceNewPlan=false, retain=false 2023-02-17 18:01:14,634 INFO [jenkins-hbase4:39369] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-17 18:01:14,638 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=96b58084280324f52a9759d84ee12306, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:14,638 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c5494d2cbfab0772cd8ed47e2da3b4b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:14,638 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=34459a93abdbe75d8f607201b16b0317, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:14,638 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e2c3d4afab922c1be50962ad98bc41da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:14,638 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874637"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874637"}]},"ts":"1676656874637"} 2023-02-17 18:01:14,638 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874638"}]},"ts":"1676656874638"} 2023-02-17 18:01:14,638 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874638"}]},"ts":"1676656874638"} 2023-02-17 18:01:14,638 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676656873810.96b58084280324f52a9759d84ee12306.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874637"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874637"}]},"ts":"1676656874637"} 2023-02-17 18:01:14,640 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=668b8c0def8ac669c2322b0032ccb53c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:14,640 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874640"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874640"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874640"}]},"ts":"1676656874640"} 2023-02-17 18:01:14,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure c5494d2cbfab0772cd8ed47e2da3b4b2, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:14,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure e2c3d4afab922c1be50962ad98bc41da, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:14,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 34459a93abdbe75d8f607201b16b0317, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:14,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure 96b58084280324f52a9759d84ee12306, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:14,649 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ed443a661d7e295cf386652efe912178, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:14,649 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874649"}]},"ts":"1676656874649"} 2023-02-17 18:01:14,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=16, state=RUNNABLE; OpenRegionProcedure 668b8c0def8ac669c2322b0032ccb53c, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:14,651 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6774bd4b3819baff6ad609f7188c1ad0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:14,651 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874651"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874651"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874651"}]},"ts":"1676656874651"} 2023-02-17 18:01:14,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=12, state=RUNNABLE; OpenRegionProcedure ed443a661d7e295cf386652efe912178, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:14,653 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=df7397fff874739e2928157f9cc3d2a0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:14,653 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656874653"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874653"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874653"}]},"ts":"1676656874653"} 2023-02-17 18:01:14,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure 6774bd4b3819baff6ad609f7188c1ad0, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:14,656 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f3e1b299e5de21dbb1cd167717a4fd6c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:14,656 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4bed7d34e697192bd3b7561af0bb94e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:14,656 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656874656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874656"}]},"ts":"1676656874656"} 2023-02-17 18:01:14,656 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656874656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656874656"}]},"ts":"1676656874656"} 2023-02-17 18:01:14,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=11, state=RUNNABLE; OpenRegionProcedure df7397fff874739e2928157f9cc3d2a0, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:14,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=20, state=RUNNABLE; OpenRegionProcedure f3e1b299e5de21dbb1cd167717a4fd6c, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:14,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 4bed7d34e697192bd3b7561af0bb94e2, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:14,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:14,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 96b58084280324f52a9759d84ee12306, NAME => 'testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-17 18:01:14,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:14,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:14,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:14,816 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:14,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:14,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ed443a661d7e295cf386652efe912178, NAME => 'testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-17 18:01:14,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ed443a661d7e295cf386652efe912178 2023-02-17 18:01:14,821 DEBUG [StoreOpener-96b58084280324f52a9759d84ee12306-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1 2023-02-17 18:01:14,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,821 DEBUG [StoreOpener-96b58084280324f52a9759d84ee12306-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1 2023-02-17 18:01:14,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ed443a661d7e295cf386652efe912178 2023-02-17 18:01:14,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ed443a661d7e295cf386652efe912178 2023-02-17 18:01:14,822 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96b58084280324f52a9759d84ee12306 columnFamilyName f1 2023-02-17 18:01:14,823 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(310): Store=96b58084280324f52a9759d84ee12306/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,823 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:14,823 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ed443a661d7e295cf386652efe912178 2023-02-17 18:01:14,826 DEBUG [StoreOpener-96b58084280324f52a9759d84ee12306-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2 2023-02-17 18:01:14,826 DEBUG [StoreOpener-96b58084280324f52a9759d84ee12306-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2 2023-02-17 18:01:14,826 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96b58084280324f52a9759d84ee12306 columnFamilyName f2 2023-02-17 18:01:14,827 DEBUG [StoreOpener-ed443a661d7e295cf386652efe912178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1 2023-02-17 18:01:14,827 DEBUG [StoreOpener-ed443a661d7e295cf386652efe912178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1 2023-02-17 18:01:14,827 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed443a661d7e295cf386652efe912178 columnFamilyName f1 2023-02-17 18:01:14,827 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(310): Store=96b58084280324f52a9759d84ee12306/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,830 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(310): Store=ed443a661d7e295cf386652efe912178/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,830 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ed443a661d7e295cf386652efe912178 2023-02-17 18:01:14,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306 2023-02-17 18:01:14,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306 2023-02-17 18:01:14,832 DEBUG [StoreOpener-ed443a661d7e295cf386652efe912178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2 2023-02-17 18:01:14,832 DEBUG [StoreOpener-ed443a661d7e295cf386652efe912178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2 2023-02-17 18:01:14,833 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed443a661d7e295cf386652efe912178 columnFamilyName f2 2023-02-17 18:01:14,834 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(310): Store=ed443a661d7e295cf386652efe912178/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:14,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178 2023-02-17 18:01:14,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178 2023-02-17 18:01:14,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:14,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:14,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:14,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ed443a661d7e295cf386652efe912178 2023-02-17 18:01:14,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 96b58084280324f52a9759d84ee12306; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60012757, jitterRate=-0.10574023425579071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:14,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 96b58084280324f52a9759d84ee12306: 2023-02-17 18:01:14,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306., pid=24, masterSystemTime=1676656874797 2023-02-17 18:01:14,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:14,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ed443a661d7e295cf386652efe912178; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73039925, jitterRate=0.08837969601154327}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:14,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ed443a661d7e295cf386652efe912178: 2023-02-17 18:01:14,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:14,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:14,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:14,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 34459a93abdbe75d8f607201b16b0317, NAME => 'testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-17 18:01:14,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178., pid=26, masterSystemTime=1676656874806 2023-02-17 18:01:14,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:14,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,848 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=96b58084280324f52a9759d84ee12306, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:14,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:14,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:14,848 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676656873810.96b58084280324f52a9759d84ee12306.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874847"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656874847"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656874847"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656874847"}]},"ts":"1676656874847"} 2023-02-17 18:01:14,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:14,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:14,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:14,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => df7397fff874739e2928157f9cc3d2a0, NAME => 'testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-17 18:01:14,851 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:14,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:14,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,852 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=ed443a661d7e295cf386652efe912178, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:14,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:14,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:14,852 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656874851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656874851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656874851"}]},"ts":"1676656874851"} 2023-02-17 18:01:14,854 DEBUG [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1 2023-02-17 18:01:14,854 DEBUG [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1 2023-02-17 18:01:14,854 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:14,855 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34459a93abdbe75d8f607201b16b0317 columnFamilyName f1 2023-02-17 18:01:14,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-17 18:01:14,857 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(310): Store=34459a93abdbe75d8f607201b16b0317/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,858 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:14,859 DEBUG [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/f1 2023-02-17 18:01:14,860 DEBUG [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/f1 2023-02-17 18:01:14,860 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df7397fff874739e2928157f9cc3d2a0 columnFamilyName f1 2023-02-17 18:01:14,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure 96b58084280324f52a9759d84ee12306, server=jenkins-hbase4.apache.org,40417,1676656869914 in 204 msec 2023-02-17 18:01:14,865 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] regionserver.HStore(310): Store=df7397fff874739e2928157f9cc3d2a0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,865 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:14,866 DEBUG [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2 2023-02-17 18:01:14,866 DEBUG [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2 2023-02-17 18:01:14,867 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34459a93abdbe75d8f607201b16b0317 columnFamilyName f2 2023-02-17 18:01:14,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=96b58084280324f52a9759d84ee12306, ASSIGN in 380 msec 2023-02-17 18:01:14,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=12 2023-02-17 18:01:14,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=12, state=SUCCESS; OpenRegionProcedure ed443a661d7e295cf386652efe912178, server=jenkins-hbase4.apache.org,40351,1676656869964 in 203 msec 2023-02-17 18:01:14,869 DEBUG [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/f2 2023-02-17 18:01:14,869 DEBUG [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/f2 2023-02-17 18:01:14,869 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(310): Store=34459a93abdbe75d8f607201b16b0317/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:14,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ed443a661d7e295cf386652efe912178, ASSIGN in 392 msec 2023-02-17 18:01:14,872 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df7397fff874739e2928157f9cc3d2a0 columnFamilyName f2 2023-02-17 18:01:14,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:14,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:14,876 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] regionserver.HStore(310): Store=df7397fff874739e2928157f9cc3d2a0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:14,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:14,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:14,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:14,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:14,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 34459a93abdbe75d8f607201b16b0317; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62611628, jitterRate=-0.06701403856277466}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:14,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 34459a93abdbe75d8f607201b16b0317: 2023-02-17 18:01:14,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317., pid=23, masterSystemTime=1676656874797 2023-02-17 18:01:14,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:14,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:14,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:14,896 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=34459a93abdbe75d8f607201b16b0317, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:14,897 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874896"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656874896"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656874896"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656874896"}]},"ts":"1676656874896"} 2023-02-17 18:01:14,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:14,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 668b8c0def8ac669c2322b0032ccb53c, NAME => 'testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-17 18:01:14,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:14,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:14,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:14,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-17 18:01:14,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=34459a93abdbe75d8f607201b16b0317, ASSIGN in 426 msec 2023-02-17 18:01:14,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 34459a93abdbe75d8f607201b16b0317, server=jenkins-hbase4.apache.org,40417,1676656869914 in 254 msec 2023-02-17 18:01:14,909 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:14,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:14,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened df7397fff874739e2928157f9cc3d2a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68789318, jitterRate=0.02504071593284607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:14,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for df7397fff874739e2928157f9cc3d2a0: 2023-02-17 18:01:14,912 DEBUG [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1 2023-02-17 18:01:14,912 DEBUG [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1 2023-02-17 18:01:14,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0., pid=28, masterSystemTime=1676656874806 2023-02-17 18:01:14,913 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 668b8c0def8ac669c2322b0032ccb53c columnFamilyName f1 2023-02-17 18:01:14,914 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(310): Store=668b8c0def8ac669c2322b0032ccb53c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,914 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:14,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:14,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:14,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:14,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f3e1b299e5de21dbb1cd167717a4fd6c, NAME => 'testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-17 18:01:14,916 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=df7397fff874739e2928157f9cc3d2a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:14,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:14,917 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656874916"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656874916"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656874916"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656874916"}]},"ts":"1676656874916"} 2023-02-17 18:01:14,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:14,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:14,917 DEBUG [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2 2023-02-17 18:01:14,918 DEBUG [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2 2023-02-17 18:01:14,918 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 668b8c0def8ac669c2322b0032ccb53c columnFamilyName f2 2023-02-17 18:01:14,919 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(310): Store=668b8c0def8ac669c2322b0032ccb53c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,919 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:14,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:14,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:14,923 DEBUG [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/f1 2023-02-17 18:01:14,923 DEBUG [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/f1 2023-02-17 18:01:14,923 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3e1b299e5de21dbb1cd167717a4fd6c columnFamilyName f1 2023-02-17 18:01:14,924 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] regionserver.HStore(310): Store=f3e1b299e5de21dbb1cd167717a4fd6c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=11 2023-02-17 18:01:14,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=11, state=SUCCESS; OpenRegionProcedure df7397fff874739e2928157f9cc3d2a0, server=jenkins-hbase4.apache.org,40351,1676656869964 in 264 msec 2023-02-17 18:01:14,925 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:14,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:14,928 DEBUG [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/f2 2023-02-17 18:01:14,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=df7397fff874739e2928157f9cc3d2a0, ASSIGN in 448 msec 2023-02-17 18:01:14,928 DEBUG [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/f2 2023-02-17 18:01:14,929 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3e1b299e5de21dbb1cd167717a4fd6c columnFamilyName f2 2023-02-17 18:01:14,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:14,929 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] regionserver.HStore(310): Store=f3e1b299e5de21dbb1cd167717a4fd6c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:14,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:14,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:14,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 668b8c0def8ac669c2322b0032ccb53c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66958400, jitterRate=-0.0022420883178710938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:14,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 668b8c0def8ac669c2322b0032ccb53c: 2023-02-17 18:01:14,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c., pid=25, masterSystemTime=1676656874797 2023-02-17 18:01:14,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:14,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:14,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:14,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:14,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:14,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5494d2cbfab0772cd8ed47e2da3b4b2, NAME => 'testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-17 18:01:14,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:14,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:14,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:14,939 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=668b8c0def8ac669c2322b0032ccb53c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:14,940 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874939"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656874939"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656874939"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656874939"}]},"ts":"1676656874939"} 2023-02-17 18:01:14,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:14,942 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:14,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f3e1b299e5de21dbb1cd167717a4fd6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62973966, jitterRate=-0.061614781618118286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:14,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f3e1b299e5de21dbb1cd167717a4fd6c: 2023-02-17 18:01:14,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c., pid=29, masterSystemTime=1676656874806 2023-02-17 18:01:14,947 DEBUG [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1 2023-02-17 18:01:14,947 DEBUG [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1 2023-02-17 18:01:14,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=16 2023-02-17 18:01:14,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:14,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=16, state=SUCCESS; OpenRegionProcedure 668b8c0def8ac669c2322b0032ccb53c, server=jenkins-hbase4.apache.org,40417,1676656869914 in 293 msec 2023-02-17 18:01:14,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:14,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:14,948 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5494d2cbfab0772cd8ed47e2da3b4b2 columnFamilyName f1 2023-02-17 18:01:14,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4bed7d34e697192bd3b7561af0bb94e2, NAME => 'testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-17 18:01:14,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:14,949 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(310): Store=c5494d2cbfab0772cd8ed47e2da3b4b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,951 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:14,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,951 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=f3e1b299e5de21dbb1cd167717a4fd6c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:14,951 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656874951"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656874951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656874951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656874951"}]},"ts":"1676656874951"} 2023-02-17 18:01:14,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:14,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:14,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=668b8c0def8ac669c2322b0032ccb53c, ASSIGN in 471 msec 2023-02-17 18:01:14,953 DEBUG [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2 2023-02-17 18:01:14,953 DEBUG [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2 2023-02-17 18:01:14,953 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5494d2cbfab0772cd8ed47e2da3b4b2 columnFamilyName f2 2023-02-17 18:01:14,954 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:14,954 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(310): Store=c5494d2cbfab0772cd8ed47e2da3b4b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:14,957 DEBUG [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1 2023-02-17 18:01:14,957 DEBUG [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1 2023-02-17 18:01:14,957 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4bed7d34e697192bd3b7561af0bb94e2 columnFamilyName f1 2023-02-17 18:01:14,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:14,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:14,959 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(310): Store=4bed7d34e697192bd3b7561af0bb94e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,960 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:14,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=20 2023-02-17 18:01:14,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=20, state=SUCCESS; OpenRegionProcedure f3e1b299e5de21dbb1cd167717a4fd6c, server=jenkins-hbase4.apache.org,40351,1676656869964 in 299 msec 2023-02-17 18:01:14,962 DEBUG [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2 2023-02-17 18:01:14,962 DEBUG [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2 2023-02-17 18:01:14,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:14,963 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4bed7d34e697192bd3b7561af0bb94e2 columnFamilyName f2 2023-02-17 18:01:14,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f3e1b299e5de21dbb1cd167717a4fd6c, ASSIGN in 484 msec 2023-02-17 18:01:14,964 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(310): Store=4bed7d34e697192bd3b7561af0bb94e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:14,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:14,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:14,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:14,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:14,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:14,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:14,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c5494d2cbfab0772cd8ed47e2da3b4b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72287410, jitterRate=0.077166348695755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:14,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c5494d2cbfab0772cd8ed47e2da3b4b2: 2023-02-17 18:01:14,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4bed7d34e697192bd3b7561af0bb94e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68120911, jitterRate=0.015080675482749939}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:14,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4bed7d34e697192bd3b7561af0bb94e2: 2023-02-17 18:01:14,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2., pid=21, masterSystemTime=1676656874797 2023-02-17 18:01:14,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2., pid=30, masterSystemTime=1676656874806 2023-02-17 18:01:14,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:14,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:14,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:14,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e2c3d4afab922c1be50962ad98bc41da, NAME => 'testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-17 18:01:14,983 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c5494d2cbfab0772cd8ed47e2da3b4b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:14,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:14,983 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874982"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656874982"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656874982"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656874982"}]},"ts":"1676656874982"} 2023-02-17 18:01:14,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:14,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:14,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:14,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:14,984 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=4bed7d34e697192bd3b7561af0bb94e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:14,984 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656874984"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656874984"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656874984"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656874984"}]},"ts":"1676656874984"} 2023-02-17 18:01:14,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:14,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6774bd4b3819baff6ad609f7188c1ad0, NAME => 'testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-17 18:01:14,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:14,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:14,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:14,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:14,986 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:14,988 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:14,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-17 18:01:14,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure c5494d2cbfab0772cd8ed47e2da3b4b2, server=jenkins-hbase4.apache.org,40417,1676656869914 in 344 msec 2023-02-17 18:01:14,990 DEBUG [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1 2023-02-17 18:01:14,990 DEBUG [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1 2023-02-17 18:01:14,991 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2c3d4afab922c1be50962ad98bc41da columnFamilyName f1 2023-02-17 18:01:14,992 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-17 18:01:14,992 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 4bed7d34e697192bd3b7561af0bb94e2, server=jenkins-hbase4.apache.org,40351,1676656869964 in 327 msec 2023-02-17 18:01:14,993 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(310): Store=e2c3d4afab922c1be50962ad98bc41da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,993 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:14,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c5494d2cbfab0772cd8ed47e2da3b4b2, ASSIGN in 513 msec 2023-02-17 18:01:14,995 DEBUG [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1 2023-02-17 18:01:14,995 DEBUG [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1 2023-02-17 18:01:14,995 DEBUG [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2 2023-02-17 18:01:14,995 DEBUG [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2 2023-02-17 18:01:14,996 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6774bd4b3819baff6ad609f7188c1ad0 columnFamilyName f1 2023-02-17 18:01:14,996 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(310): Store=6774bd4b3819baff6ad609f7188c1ad0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:14,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4bed7d34e697192bd3b7561af0bb94e2, ASSIGN in 515 msec 2023-02-17 18:01:14,996 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2c3d4afab922c1be50962ad98bc41da columnFamilyName f2 2023-02-17 18:01:14,997 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:14,999 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(310): Store=e2c3d4afab922c1be50962ad98bc41da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:15,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:15,001 DEBUG [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2 2023-02-17 18:01:15,001 DEBUG [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2 2023-02-17 18:01:15,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:15,002 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6774bd4b3819baff6ad609f7188c1ad0 columnFamilyName f2 2023-02-17 18:01:15,002 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(310): Store=6774bd4b3819baff6ad609f7188c1ad0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:15,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:15,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:15,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:15,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:15,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:15,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:15,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:15,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e2c3d4afab922c1be50962ad98bc41da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59731285, jitterRate=-0.1099344938993454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:15,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e2c3d4afab922c1be50962ad98bc41da: 2023-02-17 18:01:15,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da., pid=22, masterSystemTime=1676656874797 2023-02-17 18:01:15,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:15,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:15,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e2c3d4afab922c1be50962ad98bc41da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:15,017 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656875017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656875017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656875017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656875017"}]},"ts":"1676656875017"} 2023-02-17 18:01:15,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:15,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6774bd4b3819baff6ad609f7188c1ad0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64592551, jitterRate=-0.03749598562717438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:15,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6774bd4b3819baff6ad609f7188c1ad0: 2023-02-17 18:01:15,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0., pid=27, masterSystemTime=1676656874806 2023-02-17 18:01:15,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-17 18:01:15,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure e2c3d4afab922c1be50962ad98bc41da, server=jenkins-hbase4.apache.org,40417,1676656869914 in 376 msec 2023-02-17 18:01:15,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:15,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:15,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e2c3d4afab922c1be50962ad98bc41da, ASSIGN in 546 msec 2023-02-17 18:01:15,027 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6774bd4b3819baff6ad609f7188c1ad0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:15,027 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656875027"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656875027"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656875027"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656875027"}]},"ts":"1676656875027"} 2023-02-17 18:01:15,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-17 18:01:15,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure 6774bd4b3819baff6ad609f7188c1ad0, server=jenkins-hbase4.apache.org,40351,1676656869964 in 376 msec 2023-02-17 18:01:15,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-17 18:01:15,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6774bd4b3819baff6ad609f7188c1ad0, ASSIGN in 556 msec 2023-02-17 18:01:15,037 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:15,037 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656875037"}]},"ts":"1676656875037"} 2023-02-17 18:01:15,039 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-17 18:01:15,042 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:15,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2270 sec 2023-02-17 18:01:15,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:15,959 INFO [Listener at localhost/36077] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-17 18:01:15,960 DEBUG [Listener at localhost/36077] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-17 18:01:15,962 INFO [Listener at localhost/36077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:15,974 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-17 18:01:15,974 INFO [Listener at localhost/36077] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:15,974 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-17 18:01:15,975 INFO [Listener at localhost/36077] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 18:01:16,094 DEBUG [hconnection-0x18108b09-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:16,166 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34022, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:16,232 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40417] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:16,239 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40351] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:16,629 INFO [Listener at localhost/36077] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 18:01:16,633 INFO [Listener at localhost/36077] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 18:01:16,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 18:01:16,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676656876648 (current time:1676656876648). 2023-02-17 18:01:16,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 18:01:16,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] zookeeper.ReadOnlyZKClient(139): Connect 0x6c981e79 to 127.0.0.1:54341 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:16,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56c87f35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:16,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:16,669 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52668, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:16,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c981e79 to 127.0.0.1:54341 2023-02-17 18:01:16,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:16,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 18:01:16,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 18:01:16,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 18:01:16,699 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 18:01:16,701 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676657476701 2023-02-17 18:01:16,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 18:01:16,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-17 18:01:16,704 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 18:01:16,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 18:01:16,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 13 msec 2023-02-17 18:01:16,706 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 18:01:16,707 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676657476707 2023-02-17 18:01:16,708 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:16,708 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 18:01:16,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-17 18:01:16,733 INFO [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-17 18:01:16,733 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:16,733 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-17 18:01:16,733 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-17 18:01:16,734 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:16,734 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 18:01:16,735 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:16,735 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:16,736 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:16,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:16,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:16,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:16,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:16,736 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:16,736 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:16,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 18:01:16,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 18:01:16,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:16,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:16,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-17 18:01:16,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-17 18:01:16,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 18:01:16,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 18:01:16,738 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:16,738 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:16,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 18:01:16,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 18:01:16,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-17 18:01:16,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-17 18:01:16,741 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-17 18:01:16,741 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:16,741 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-17 18:01:16,741 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:16,741 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 18:01:16,741 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 18:01:16,741 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-17 18:01:16,741 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-17 18:01:16,742 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40351,1676656869964' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-17 18:01:16,742 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40417,1676656869914' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-17 18:01:16,744 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:16,744 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:16,746 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:16,746 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:16,746 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,746 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:16,746 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,746 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 18:01:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:16,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40351,1676656869964' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-17 18:01:16,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22e61914[Count = 1] remaining members to acquire global barrier 2023-02-17 18:01:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 18:01:16,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:16,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:16,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:16,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40417,1676656869914' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-17 18:01:16,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22e61914[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:16,752 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-17 18:01:16,752 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,753 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,753 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:16,754 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 18:01:16,754 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:16,754 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 18:01:16,754 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:16,754 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:16,755 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:16,755 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:16,755 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:16,755 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:16,755 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. started... 2023-02-17 18:01:16,755 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. started... 2023-02-17 18:01:16,755 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. started... 2023-02-17 18:01:16,755 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. started... 2023-02-17 18:01:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 18:01:16,756 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 18:01:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:01:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:01:16,756 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:16,756 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. started... 2023-02-17 18:01:16,756 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. started... 2023-02-17 18:01:16,758 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c5494d2cbfab0772cd8ed47e2da3b4b2 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 18:01:16,759 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 668b8c0def8ac669c2322b0032ccb53c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:16,759 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6774bd4b3819baff6ad609f7188c1ad0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:16,758 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 96b58084280324f52a9759d84ee12306 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:16,760 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4bed7d34e697192bd3b7561af0bb94e2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:16,760 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for df7397fff874739e2928157f9cc3d2a0: 2023-02-17 18:01:16,761 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:16,768 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:16,772 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:16,773 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:16,795 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. completed. 2023-02-17 18:01:16,795 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:16,796 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:16,796 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 18:01:16,796 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. started... 2023-02-17 18:01:16,796 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f3e1b299e5de21dbb1cd167717a4fd6c: 2023-02-17 18:01:16,797 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:16,797 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:16,797 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:16,797 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:16,808 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:16,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:01:16,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:16,815 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 18:01:16,816 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. completed. 2023-02-17 18:01:16,816 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:16,816 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:16,816 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 18:01:16,816 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. started... 2023-02-17 18:01:16,817 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ed443a661d7e295cf386652efe912178 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 18:01:16,956 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/.tmp/f1/91bea2be4a0d4e1d8e35b5ef8aeb5f0e 2023-02-17 18:01:16,992 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/.tmp/f1/b852be2d1b8946c0aa1f102b8698f85f 2023-02-17 18:01:17,015 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:17,018 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/.tmp/f1/a6b83f2ce9f7477485192db429c782d2 2023-02-17 18:01:17,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:01:17,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:17,019 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-17 18:01:17,020 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/.tmp/f1/6cfda25d9fc24ab19fd9d20de62a7f9e 2023-02-17 18:01:17,113 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/.tmp/f2/0b0b60a2a7454fce9dd5c91932f8b727 2023-02-17 18:01:17,115 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/.tmp/f2/532de90553cd4c6ba920e1850183ce88 2023-02-17 18:01:17,126 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/.tmp/f1/6cfda25d9fc24ab19fd9d20de62a7f9e as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/6cfda25d9fc24ab19fd9d20de62a7f9e 2023-02-17 18:01:17,128 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/.tmp/f1/b852be2d1b8946c0aa1f102b8698f85f as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/b852be2d1b8946c0aa1f102b8698f85f 2023-02-17 18:01:17,137 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/6cfda25d9fc24ab19fd9d20de62a7f9e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,139 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/b852be2d1b8946c0aa1f102b8698f85f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:17,140 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/.tmp/f2/0b0b60a2a7454fce9dd5c91932f8b727 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/0b0b60a2a7454fce9dd5c91932f8b727 2023-02-17 18:01:17,141 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/.tmp/f2/532de90553cd4c6ba920e1850183ce88 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/532de90553cd4c6ba920e1850183ce88 2023-02-17 18:01:17,149 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/0b0b60a2a7454fce9dd5c91932f8b727, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,150 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/532de90553cd4c6ba920e1850183ce88, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:17,150 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 668b8c0def8ac669c2322b0032ccb53c in 392ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:17,152 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ed443a661d7e295cf386652efe912178 in 335ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:17,152 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-17 18:01:17,152 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-17 18:01:17,154 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 668b8c0def8ac669c2322b0032ccb53c: 2023-02-17 18:01:17,154 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ed443a661d7e295cf386652efe912178: 2023-02-17 18:01:17,155 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,155 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:17,155 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,155 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/6cfda25d9fc24ab19fd9d20de62a7f9e] hfiles 2023-02-17 18:01:17,155 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:17,155 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/6cfda25d9fc24ab19fd9d20de62a7f9e for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,155 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/b852be2d1b8946c0aa1f102b8698f85f] hfiles 2023-02-17 18:01:17,155 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/b852be2d1b8946c0aa1f102b8698f85f for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,159 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/532de90553cd4c6ba920e1850183ce88] hfiles 2023-02-17 18:01:17,159 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/0b0b60a2a7454fce9dd5c91932f8b727] hfiles 2023-02-17 18:01:17,159 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/532de90553cd4c6ba920e1850183ce88 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,159 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/0b0b60a2a7454fce9dd5c91932f8b727 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,171 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. completed. 2023-02-17 18:01:17,171 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:17,172 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:17,172 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 18:01:17,172 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. started... 2023-02-17 18:01:17,172 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e2c3d4afab922c1be50962ad98bc41da 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:17,187 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/.tmp/f1/1d2c681500db4af681bdff60a153f052 2023-02-17 18:01:17,207 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/.tmp/f2/b81c1d01bf8e49d68a210e0c910fece1 2023-02-17 18:01:17,214 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/.tmp/f1/1d2c681500db4af681bdff60a153f052 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/1d2c681500db4af681bdff60a153f052 2023-02-17 18:01:17,221 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/1d2c681500db4af681bdff60a153f052, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,222 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/.tmp/f2/b81c1d01bf8e49d68a210e0c910fece1 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/b81c1d01bf8e49d68a210e0c910fece1 2023-02-17 18:01:17,229 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/b81c1d01bf8e49d68a210e0c910fece1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,231 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e2c3d4afab922c1be50962ad98bc41da in 58ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:17,231 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e2c3d4afab922c1be50962ad98bc41da: 2023-02-17 18:01:17,231 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,231 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:17,231 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/1d2c681500db4af681bdff60a153f052] hfiles 2023-02-17 18:01:17,231 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/1d2c681500db4af681bdff60a153f052 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,231 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/b81c1d01bf8e49d68a210e0c910fece1] hfiles 2023-02-17 18:01:17,231 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/b81c1d01bf8e49d68a210e0c910fece1 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,240 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. completed. 2023-02-17 18:01:17,240 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:17,240 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:17,240 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 18:01:17,240 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. started... 2023-02-17 18:01:17,241 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 34459a93abdbe75d8f607201b16b0317 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:17,259 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/.tmp/f1/4053cc4771374f4db70fd4abef4a8d57 2023-02-17 18:01:17,287 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/.tmp/f2/15cf6e1bff074359a062cd59da36d007 2023-02-17 18:01:17,295 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/.tmp/f1/4053cc4771374f4db70fd4abef4a8d57 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/4053cc4771374f4db70fd4abef4a8d57 2023-02-17 18:01:17,302 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/4053cc4771374f4db70fd4abef4a8d57, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,303 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/.tmp/f2/15cf6e1bff074359a062cd59da36d007 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/15cf6e1bff074359a062cd59da36d007 2023-02-17 18:01:17,312 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/15cf6e1bff074359a062cd59da36d007, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,313 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 34459a93abdbe75d8f607201b16b0317 in 72ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:17,313 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 34459a93abdbe75d8f607201b16b0317: 2023-02-17 18:01:17,313 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,314 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:17,314 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/4053cc4771374f4db70fd4abef4a8d57] hfiles 2023-02-17 18:01:17,314 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/4053cc4771374f4db70fd4abef4a8d57 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,314 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/15cf6e1bff074359a062cd59da36d007] hfiles 2023-02-17 18:01:17,314 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/15cf6e1bff074359a062cd59da36d007 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,319 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:17,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:01:17,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:17,321 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-17 18:01:17,337 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. completed. 2023-02-17 18:01:17,337 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:17,337 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 18:01:17,415 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/.tmp/f1/716c4128bc7e4ed4bd09a274244bb059 2023-02-17 18:01:17,420 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/.tmp/f1/2904877d0d60457aa6c4e2ba3d624766 2023-02-17 18:01:17,446 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/.tmp/f2/bbba70394cf448fe934710b165444be5 2023-02-17 18:01:17,449 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/.tmp/f2/9fbcb27120724989987c49f0ea68af36 2023-02-17 18:01:17,456 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/.tmp/f1/716c4128bc7e4ed4bd09a274244bb059 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/716c4128bc7e4ed4bd09a274244bb059 2023-02-17 18:01:17,458 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/.tmp/f1/2904877d0d60457aa6c4e2ba3d624766 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/2904877d0d60457aa6c4e2ba3d624766 2023-02-17 18:01:17,466 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/716c4128bc7e4ed4bd09a274244bb059, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,467 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/.tmp/f2/bbba70394cf448fe934710b165444be5 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/bbba70394cf448fe934710b165444be5 2023-02-17 18:01:17,468 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/2904877d0d60457aa6c4e2ba3d624766, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,469 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/.tmp/f2/9fbcb27120724989987c49f0ea68af36 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/9fbcb27120724989987c49f0ea68af36 2023-02-17 18:01:17,477 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/bbba70394cf448fe934710b165444be5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,478 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 96b58084280324f52a9759d84ee12306 in 720ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:17,479 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/9fbcb27120724989987c49f0ea68af36, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,479 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 96b58084280324f52a9759d84ee12306: 2023-02-17 18:01:17,479 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,479 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:17,479 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/716c4128bc7e4ed4bd09a274244bb059] hfiles 2023-02-17 18:01:17,479 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/716c4128bc7e4ed4bd09a274244bb059 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,479 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/bbba70394cf448fe934710b165444be5] hfiles 2023-02-17 18:01:17,479 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/bbba70394cf448fe934710b165444be5 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,480 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4bed7d34e697192bd3b7561af0bb94e2 in 720ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:17,480 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4bed7d34e697192bd3b7561af0bb94e2: 2023-02-17 18:01:17,480 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,480 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:17,480 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/2904877d0d60457aa6c4e2ba3d624766] hfiles 2023-02-17 18:01:17,480 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/2904877d0d60457aa6c4e2ba3d624766 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,480 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/9fbcb27120724989987c49f0ea68af36] hfiles 2023-02-17 18:01:17,480 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/9fbcb27120724989987c49f0ea68af36 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,500 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. completed. 2023-02-17 18:01:17,500 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:17,500 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 18:01:17,504 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. completed. 2023-02-17 18:01:17,504 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:17,504 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 18:01:17,513 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/.tmp/f2/be2c24fa8bf646569164554d4e65be06 2023-02-17 18:01:17,516 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/.tmp/f2/d6348719063d452b8a75432e33ac1890 2023-02-17 18:01:17,524 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/.tmp/f1/91bea2be4a0d4e1d8e35b5ef8aeb5f0e as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/91bea2be4a0d4e1d8e35b5ef8aeb5f0e 2023-02-17 18:01:17,526 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/.tmp/f1/a6b83f2ce9f7477485192db429c782d2 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/a6b83f2ce9f7477485192db429c782d2 2023-02-17 18:01:17,532 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/91bea2be4a0d4e1d8e35b5ef8aeb5f0e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:17,534 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/.tmp/f2/be2c24fa8bf646569164554d4e65be06 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/be2c24fa8bf646569164554d4e65be06 2023-02-17 18:01:17,535 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/a6b83f2ce9f7477485192db429c782d2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,536 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/.tmp/f2/d6348719063d452b8a75432e33ac1890 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/d6348719063d452b8a75432e33ac1890 2023-02-17 18:01:17,546 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/be2c24fa8bf646569164554d4e65be06, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:17,546 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/d6348719063d452b8a75432e33ac1890, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:17,548 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6774bd4b3819baff6ad609f7188c1ad0 in 790ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:17,548 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for c5494d2cbfab0772cd8ed47e2da3b4b2 in 791ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6774bd4b3819baff6ad609f7188c1ad0: 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c5494d2cbfab0772cd8ed47e2da3b4b2: 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/91bea2be4a0d4e1d8e35b5ef8aeb5f0e] hfiles 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/a6b83f2ce9f7477485192db429c782d2] hfiles 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/91bea2be4a0d4e1d8e35b5ef8aeb5f0e for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/a6b83f2ce9f7477485192db429c782d2 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/be2c24fa8bf646569164554d4e65be06] hfiles 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/d6348719063d452b8a75432e33ac1890] hfiles 2023-02-17 18:01:17,548 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/be2c24fa8bf646569164554d4e65be06 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,549 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/d6348719063d452b8a75432e33ac1890 for snapshot=testWithMapReduceMultiRegion 2023-02-17 18:01:17,571 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. completed. 2023-02-17 18:01:17,571 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:17,571 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 18:01:17,572 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. completed. 2023-02-17 18:01:17,572 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:17,572 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. completed. 2023-02-17 18:01:17,572 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 18:01:17,572 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 18:01:17,572 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:17,573 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,573 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 18:01:17,573 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 18:01:17,573 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-17 18:01:17,573 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,573 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40417,1676656869914' in zk 2023-02-17 18:01:17,573 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-17 18:01:17,573 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40351,1676656869964' in zk 2023-02-17 18:01:17,577 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,577 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-17 18:01:17,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:17,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:17,577 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:17,577 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-17 18:01:17,578 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-17 18:01:17,578 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,578 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:17,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:17,578 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-17 18:01:17,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 18:01:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 18:01:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40417,1676656869914': 2023-02-17 18:01:17,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40417,1676656869914' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 18:01:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 18:01:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 18:01:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40351,1676656869964': 2023-02-17 18:01:17,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40351,1676656869964' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 18:01:17,589 INFO [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-17 18:01:17,589 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:17,589 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:17,589 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-17 18:01:17,589 INFO [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 18:01:17,593 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,593 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,593 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:17,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,593 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,593 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:17,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:17,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:17,594 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,595 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 18:01:17,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:17,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 18:01:17,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,597 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:17,597 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-17 18:01:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,611 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,611 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:17,611 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:17,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:17,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:17,611 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:17,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:17,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:17,611 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:17,611 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 18:01:17,612 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,612 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-17 18:01:17,612 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:17,612 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:17,612 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:17,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-17 18:01:17,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:17,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:17,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:17,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:17,612 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:17,613 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-17 18:01:17,613 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-17 18:01:17,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-17 18:01:17,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-17 18:01:17,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-17 18:01:17,744 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-17 18:01:17,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-17 18:01:17,744 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-17 18:01:17,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676656876702Consolidate snapshot: testWithMapReduceMultiRegion at 1676656877612 (+910 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676656877613 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676656877639 (+26 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676656877657 (+18 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676656877744 (+87 ms) 2023-02-17 18:01:17,745 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 18:01:17,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0420 sec 2023-02-17 18:01:17,822 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:17,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:01:17,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 18:01:17,824 INFO [Listener at localhost/36077] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 18:01:17,837 INFO [Listener at localhost/36077] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 18:01:17,852 INFO [Listener at localhost/36077] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 18:01:17,929 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40351] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:17,929 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40417] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:18,102 INFO [Listener at localhost/36077] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 18:01:18,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 18:01:18,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-17 18:01:18,126 INFO [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-17 18:01:18,126 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:18,127 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-17 18:01:18,127 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-17 18:01:18,128 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,128 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:18,129 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:18,129 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:18,129 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:18,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:18,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:18,130 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,130 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:18,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:18,130 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,130 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:18,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:18,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:18,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:18,131 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 18:01:18,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:18,131 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 18:01:18,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 18:01:18,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 18:01:18,133 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 18:01:18,133 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 18:01:18,133 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:18,133 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:18,133 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 18:01:18,134 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 18:01:18,135 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:18,135 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:18,135 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. started... 2023-02-17 18:01:18,135 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. started... 2023-02-17 18:01:18,135 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:18,135 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 96b58084280324f52a9759d84ee12306 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:18,135 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. started... 2023-02-17 18:01:18,135 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6774bd4b3819baff6ad609f7188c1ad0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:18,135 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c5494d2cbfab0772cd8ed47e2da3b4b2 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 18:01:18,136 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:18,136 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. started... 2023-02-17 18:01:18,136 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for df7397fff874739e2928157f9cc3d2a0: 2023-02-17 18:01:18,136 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:18,136 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 18:01:18,137 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:01:18,137 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:18,137 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. started... 2023-02-17 18:01:18,137 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 18:01:18,137 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:18,138 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:01:18,138 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. started... 2023-02-17 18:01:18,138 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 18:01:18,138 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f3e1b299e5de21dbb1cd167717a4fd6c: 2023-02-17 18:01:18,138 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 668b8c0def8ac669c2322b0032ccb53c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:18,138 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:18,139 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:18,139 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:18,139 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. started... 2023-02-17 18:01:18,140 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ed443a661d7e295cf386652efe912178 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 18:01:18,139 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. started... 2023-02-17 18:01:18,139 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 18:01:18,141 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4bed7d34e697192bd3b7561af0bb94e2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:18,229 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/.tmp/f1/8a79df65a3524e8e8a229db320be7542 2023-02-17 18:01:18,235 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/.tmp/f1/df89fcb892b3437cb321c46e76570d2f 2023-02-17 18:01:18,238 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/.tmp/f1/7530a1d36fd748baa746e41f46565e4a 2023-02-17 18:01:18,241 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/.tmp/f1/a16526943d4f4f80a5f8fedc10703ad1 2023-02-17 18:01:18,245 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-17 18:01:18,276 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/.tmp/f2/666b13b67ca64ac895361de5d2bff22d 2023-02-17 18:01:18,281 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/.tmp/f2/26f3f5a3a0b94e97a59d2726ad20b921 2023-02-17 18:01:18,287 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/.tmp/f1/7530a1d36fd748baa746e41f46565e4a as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/7530a1d36fd748baa746e41f46565e4a 2023-02-17 18:01:18,293 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/.tmp/f2/13eadc69589e450db398593a6e5944e8 2023-02-17 18:01:18,293 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/.tmp/f1/df89fcb892b3437cb321c46e76570d2f as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/df89fcb892b3437cb321c46e76570d2f 2023-02-17 18:01:18,295 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/7530a1d36fd748baa746e41f46565e4a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,297 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/.tmp/f2/666b13b67ca64ac895361de5d2bff22d as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/666b13b67ca64ac895361de5d2bff22d 2023-02-17 18:01:18,306 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/666b13b67ca64ac895361de5d2bff22d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,307 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/.tmp/f1/8a79df65a3524e8e8a229db320be7542 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/8a79df65a3524e8e8a229db320be7542 2023-02-17 18:01:18,307 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6774bd4b3819baff6ad609f7188c1ad0 in 172ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:18,308 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6774bd4b3819baff6ad609f7188c1ad0: 2023-02-17 18:01:18,308 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:18,308 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 18:01:18,310 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/df89fcb892b3437cb321c46e76570d2f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,311 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/.tmp/f2/26f3f5a3a0b94e97a59d2726ad20b921 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/26f3f5a3a0b94e97a59d2726ad20b921 2023-02-17 18:01:18,313 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/.tmp/f2/c4340f500e944d89b404dc60b3d5dbcc 2023-02-17 18:01:18,320 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/.tmp/f1/a16526943d4f4f80a5f8fedc10703ad1 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/a16526943d4f4f80a5f8fedc10703ad1 2023-02-17 18:01:18,322 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/8a79df65a3524e8e8a229db320be7542, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:18,324 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/.tmp/f2/13eadc69589e450db398593a6e5944e8 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/13eadc69589e450db398593a6e5944e8 2023-02-17 18:01:18,325 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/26f3f5a3a0b94e97a59d2726ad20b921, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,326 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 96b58084280324f52a9759d84ee12306 in 191ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:18,326 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 96b58084280324f52a9759d84ee12306: 2023-02-17 18:01:18,326 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:18,326 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 18:01:18,326 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. started... 2023-02-17 18:01:18,327 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e2c3d4afab922c1be50962ad98bc41da 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:18,337 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/a16526943d4f4f80a5f8fedc10703ad1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,338 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/13eadc69589e450db398593a6e5944e8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:18,338 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/.tmp/f2/c4340f500e944d89b404dc60b3d5dbcc as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/c4340f500e944d89b404dc60b3d5dbcc 2023-02-17 18:01:18,340 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for c5494d2cbfab0772cd8ed47e2da3b4b2 in 205ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:18,340 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c5494d2cbfab0772cd8ed47e2da3b4b2: 2023-02-17 18:01:18,340 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:18,340 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:18,340 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 18:01:18,340 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. started... 2023-02-17 18:01:18,341 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 34459a93abdbe75d8f607201b16b0317 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:18,353 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-17 18:01:18,354 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/c4340f500e944d89b404dc60b3d5dbcc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,355 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4bed7d34e697192bd3b7561af0bb94e2 in 215ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:18,355 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4bed7d34e697192bd3b7561af0bb94e2: 2023-02-17 18:01:18,355 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:18,356 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 18:01:18,356 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-17 18:01:18,372 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/.tmp/f1/02752c376d4f4e58a92b6296f31657be 2023-02-17 18:01:18,377 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/.tmp/f1/fb40bfb59fa64b4f8006b95ed913860a 2023-02-17 18:01:18,407 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/.tmp/f2/50da5c2059264f83a542cc93224f70cd 2023-02-17 18:01:18,414 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/.tmp/f2/f1c341929d8a4249ba033268abe9ee3c 2023-02-17 18:01:18,415 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/.tmp/f1/02752c376d4f4e58a92b6296f31657be as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/02752c376d4f4e58a92b6296f31657be 2023-02-17 18:01:18,422 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/.tmp/f1/fb40bfb59fa64b4f8006b95ed913860a as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/fb40bfb59fa64b4f8006b95ed913860a 2023-02-17 18:01:18,422 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/02752c376d4f4e58a92b6296f31657be, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,423 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/.tmp/f2/50da5c2059264f83a542cc93224f70cd as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/50da5c2059264f83a542cc93224f70cd 2023-02-17 18:01:18,428 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/fb40bfb59fa64b4f8006b95ed913860a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,430 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/.tmp/f2/f1c341929d8a4249ba033268abe9ee3c as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/f1c341929d8a4249ba033268abe9ee3c 2023-02-17 18:01:18,431 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/50da5c2059264f83a542cc93224f70cd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,432 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e2c3d4afab922c1be50962ad98bc41da in 105ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:18,432 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e2c3d4afab922c1be50962ad98bc41da: 2023-02-17 18:01:18,432 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:18,432 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 18:01:18,436 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/f1c341929d8a4249ba033268abe9ee3c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,437 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 34459a93abdbe75d8f607201b16b0317 in 97ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:18,437 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 34459a93abdbe75d8f607201b16b0317: 2023-02-17 18:01:18,437 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:18,437 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 18:01:18,649 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/.tmp/f1/ff414b7a464d43ccae50a299f35f33f9 2023-02-17 18:01:18,649 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/.tmp/f1/e29a56fa189341a9a9582afd20cc35d1 2023-02-17 18:01:18,670 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/.tmp/f2/edb19dd42a724d19904df516d74f40ac 2023-02-17 18:01:18,672 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/.tmp/f2/aa8f7eef462746bea58f66c01e620d16 2023-02-17 18:01:18,679 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/.tmp/f1/ff414b7a464d43ccae50a299f35f33f9 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/ff414b7a464d43ccae50a299f35f33f9 2023-02-17 18:01:18,679 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/.tmp/f1/e29a56fa189341a9a9582afd20cc35d1 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/e29a56fa189341a9a9582afd20cc35d1 2023-02-17 18:01:18,686 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/e29a56fa189341a9a9582afd20cc35d1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:18,686 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/ff414b7a464d43ccae50a299f35f33f9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,687 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/.tmp/f2/edb19dd42a724d19904df516d74f40ac as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/edb19dd42a724d19904df516d74f40ac 2023-02-17 18:01:18,687 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/.tmp/f2/aa8f7eef462746bea58f66c01e620d16 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/aa8f7eef462746bea58f66c01e620d16 2023-02-17 18:01:18,693 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/edb19dd42a724d19904df516d74f40ac, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:18,694 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/aa8f7eef462746bea58f66c01e620d16, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:18,694 INFO [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ed443a661d7e295cf386652efe912178 in 555ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:18,695 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ed443a661d7e295cf386652efe912178: 2023-02-17 18:01:18,695 DEBUG [rs(jenkins-hbase4.apache.org,40351,1676656869964)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 18:01:18,695 INFO [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 668b8c0def8ac669c2322b0032ccb53c in 557ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 18:01:18,695 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 668b8c0def8ac669c2322b0032ccb53c: 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,695 DEBUG [rs(jenkins-hbase4.apache.org,40417,1676656869914)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40351,1676656869964' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 18:01:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40417,1676656869914' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 18:01:18,698 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,698 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,698 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,698 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:18,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:18,698 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,698 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:18,698 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,698 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:18,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:18,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:18,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:18,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40417,1676656869914' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 18:01:18,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6641d2c0[Count = 1] remaining members to acquire global barrier 2023-02-17 18:01:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:18,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:18,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:18,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:18,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40351,1676656869964' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 18:01:18,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6641d2c0[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:18,704 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-17 18:01:18,704 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,707 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,707 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,708 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 18:01:18,708 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 18:01:18,708 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 18:01:18,708 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40417,1676656869914' in zk 2023-02-17 18:01:18,708 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,708 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 18:01:18,708 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40351,1676656869964' in zk 2023-02-17 18:01:18,709 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,709 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:18,710 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 18:01:18,710 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,710 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:18,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:18,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:18,710 DEBUG [member: 'jenkins-hbase4.apache.org,40417,1676656869914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 18:01:18,711 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 18:01:18,711 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,711 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:18,711 DEBUG [member: 'jenkins-hbase4.apache.org,40351,1676656869964' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 18:01:18,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:18,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:18,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:18,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:18,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:18,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40417,1676656869914': 2023-02-17 18:01:18,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40417,1676656869914' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-17 18:01:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:18,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:18,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:18,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:18,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:18,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40351,1676656869964': 2023-02-17 18:01:18,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40351,1676656869964' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-17 18:01:18,719 INFO [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-17 18:01:18,719 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:18,719 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:18,719 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-17 18:01:18,719 INFO [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 18:01:18,721 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,721 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,721 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,721 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:18,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:18,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:18,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,721 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:18,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,722 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:18,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:18,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:18,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:18,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:18,723 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:18,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:18,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:18,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,725 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:18,725 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:18,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,731 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,732 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:18,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:18,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:18,732 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:18,732 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,732 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:18,732 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:18,732 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:18,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:18,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:18,732 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:18,732 DEBUG [(jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:18,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-17 18:01:18,732 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:18,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 18:01:18,733 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,733 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:18,733 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:18,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:18,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:18,733 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:18,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:18,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:18,735 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:18,735 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 18:01:18,835 DEBUG [Listener at localhost/36077] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 18:01:18,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 18:01:18,900 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 18:01:18,901 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-17 18:01:18,943 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/hadoop-7694923683540796477.jar 2023-02-17 18:01:18,960 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676656876648 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:18,961 DEBUG [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce 2023-02-17 18:01:18,961 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:18,961 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(239): region to add: ed443a661d7e295cf386652efe912178 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=96b58084280324f52a9759d84ee12306 as 96b58084280324f52a9759d84ee12306 in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=c5494d2cbfab0772cd8ed47e2da3b4b2 as c5494d2cbfab0772cd8ed47e2da3b4b2 in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=668b8c0def8ac669c2322b0032ccb53c as 668b8c0def8ac669c2322b0032ccb53c in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,962 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=6774bd4b3819baff6ad609f7188c1ad0 as 6774bd4b3819baff6ad609f7188c1ad0 in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,963 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=df7397fff874739e2928157f9cc3d2a0 as df7397fff874739e2928157f9cc3d2a0 in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,963 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=4bed7d34e697192bd3b7561af0bb94e2 as 4bed7d34e697192bd3b7561af0bb94e2 in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,963 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=e2c3d4afab922c1be50962ad98bc41da as e2c3d4afab922c1be50962ad98bc41da in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,963 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=f3e1b299e5de21dbb1cd167717a4fd6c as f3e1b299e5de21dbb1cd167717a4fd6c in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,963 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=34459a93abdbe75d8f607201b16b0317 as 34459a93abdbe75d8f607201b16b0317 in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,963 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(585): clone region=ed443a661d7e295cf386652efe912178 as ed443a661d7e295cf386652efe912178 in snapshot testWithMapReduceMultiRegion 2023-02-17 18:01:18,967 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 4bed7d34e697192bd3b7561af0bb94e2, NAME => 'testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:18,967 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => df7397fff874739e2928157f9cc3d2a0, NAME => 'testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:18,968 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 668b8c0def8ac669c2322b0032ccb53c, NAME => 'testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:18,968 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => c5494d2cbfab0772cd8ed47e2da3b4b2, NAME => 'testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:18,968 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e2c3d4afab922c1be50962ad98bc41da, NAME => 'testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:18,968 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 6774bd4b3819baff6ad609f7188c1ad0, NAME => 'testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:18,968 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => f3e1b299e5de21dbb1cd167717a4fd6c, NAME => 'testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:18,969 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 96b58084280324f52a9759d84ee12306, NAME => 'testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:19,001 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,001 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1d2c681500db4af681bdff60a153f052 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,004 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,004 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2904877d0d60457aa6c4e2ba3d624766 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,006 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,006 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a6b83f2ce9f7477485192db429c782d2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,007 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,007 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 716c4128bc7e4ed4bd09a274244bb059 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,020 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b81c1d01bf8e49d68a210e0c910fece1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,021 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,021 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6cfda25d9fc24ab19fd9d20de62a7f9e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,031 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d6348719063d452b8a75432e33ac1890 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,031 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9fbcb27120724989987c49f0ea68af36 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,031 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,032 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0b0b60a2a7454fce9dd5c91932f8b727 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,032 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing f3e1b299e5de21dbb1cd167717a4fd6c, disabling compactions & flushes 2023-02-17 18:01:19,032 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:19,032 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:19,032 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. after waiting 0 ms 2023-02-17 18:01:19,032 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:19,032 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:19,032 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for f3e1b299e5de21dbb1cd167717a4fd6c: 2023-02-17 18:01:19,033 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 34459a93abdbe75d8f607201b16b0317, NAME => 'testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:19,033 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,033 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,033 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing df7397fff874739e2928157f9cc3d2a0, disabling compactions & flushes 2023-02-17 18:01:19,033 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91bea2be4a0d4e1d8e35b5ef8aeb5f0e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,033 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:19,034 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:19,034 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. after waiting 0 ms 2023-02-17 18:01:19,034 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:19,034 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:19,034 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for df7397fff874739e2928157f9cc3d2a0: 2023-02-17 18:01:19,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e2c3d4afab922c1be50962ad98bc41da, disabling compactions & flushes 2023-02-17 18:01:19,034 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ed443a661d7e295cf386652efe912178, NAME => 'testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:19,034 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:19,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:19,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. after waiting 0 ms 2023-02-17 18:01:19,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:19,035 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:19,035 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e2c3d4afab922c1be50962ad98bc41da: 2023-02-17 18:01:19,035 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bbba70394cf448fe934710b165444be5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,037 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 668b8c0def8ac669c2322b0032ccb53c, disabling compactions & flushes 2023-02-17 18:01:19,037 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:19,037 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 6774bd4b3819baff6ad609f7188c1ad0, disabling compactions & flushes 2023-02-17 18:01:19,038 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:19,038 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:19,038 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:19,038 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. after waiting 0 ms 2023-02-17 18:01:19,038 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:19,038 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:19,038 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 6774bd4b3819baff6ad609f7188c1ad0: 2023-02-17 18:01:19,038 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. after waiting 0 ms 2023-02-17 18:01:19,038 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:19,038 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:19,038 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 668b8c0def8ac669c2322b0032ccb53c: 2023-02-17 18:01:19,039 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 4bed7d34e697192bd3b7561af0bb94e2, disabling compactions & flushes 2023-02-17 18:01:19,039 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:19,039 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:19,039 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. after waiting 0 ms 2023-02-17 18:01:19,039 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:19,039 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink be2c24fa8bf646569164554d4e65be06 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,039 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:19,039 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 4bed7d34e697192bd3b7561af0bb94e2: 2023-02-17 18:01:19,041 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 96b58084280324f52a9759d84ee12306, disabling compactions & flushes 2023-02-17 18:01:19,041 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:19,041 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:19,041 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. after waiting 0 ms 2023-02-17 18:01:19,041 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:19,041 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:19,041 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 96b58084280324f52a9759d84ee12306: 2023-02-17 18:01:19,044 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing c5494d2cbfab0772cd8ed47e2da3b4b2, disabling compactions & flushes 2023-02-17 18:01:19,044 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:19,044 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:19,044 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. after waiting 0 ms 2023-02-17 18:01:19,044 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:19,045 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:19,045 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for c5494d2cbfab0772cd8ed47e2da3b4b2: 2023-02-17 18:01:19,047 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,048 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4053cc4771374f4db70fd4abef4a8d57 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,050 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,050 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b852be2d1b8946c0aa1f102b8698f85f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,051 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 15cf6e1bff074359a062cd59da36d007 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,052 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 532de90553cd4c6ba920e1850183ce88 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-17 18:01:19,053 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 34459a93abdbe75d8f607201b16b0317, disabling compactions & flushes 2023-02-17 18:01:19,053 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:19,053 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:19,053 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. after waiting 0 ms 2023-02-17 18:01:19,053 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:19,053 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:19,053 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 34459a93abdbe75d8f607201b16b0317: 2023-02-17 18:01:19,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ed443a661d7e295cf386652efe912178, disabling compactions & flushes 2023-02-17 18:01:19,055 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:19,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:19,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. after waiting 0 ms 2023-02-17 18:01:19,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:19,055 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:19,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ed443a661d7e295cf386652efe912178: 2023-02-17 18:01:19,055 INFO [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676656876648 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:19,055 DEBUG [Listener at localhost/36077] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:19,056 DEBUG [Listener at localhost/36077] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa 2023-02-17 18:01:19,056 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-data/ 2023-02-17 18:01:19,057 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----default/ 2023-02-17 18:01:19,057 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-17 18:01:19,058 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------34459a93abdbe75d8f607201b16b0317/ 2023-02-17 18:01:19,058 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,059 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:19,059 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=34459a93abdbe75d8f607201b16b0317-4053cc4771374f4db70fd4abef4a8d57 2023-02-17 18:01:19,059 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:19,060 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=34459a93abdbe75d8f607201b16b0317-15cf6e1bff074359a062cd59da36d007 2023-02-17 18:01:19,060 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------4bed7d34e697192bd3b7561af0bb94e2/ 2023-02-17 18:01:19,060 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,060 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:19,061 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=4bed7d34e697192bd3b7561af0bb94e2-2904877d0d60457aa6c4e2ba3d624766 2023-02-17 18:01:19,061 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:19,061 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=4bed7d34e697192bd3b7561af0bb94e2-9fbcb27120724989987c49f0ea68af36 2023-02-17 18:01:19,061 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------668b8c0def8ac669c2322b0032ccb53c/ 2023-02-17 18:01:19,062 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,062 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:19,062 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=668b8c0def8ac669c2322b0032ccb53c-6cfda25d9fc24ab19fd9d20de62a7f9e 2023-02-17 18:01:19,063 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:19,063 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=668b8c0def8ac669c2322b0032ccb53c-0b0b60a2a7454fce9dd5c91932f8b727 2023-02-17 18:01:19,063 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------6774bd4b3819baff6ad609f7188c1ad0/ 2023-02-17 18:01:19,064 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,064 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:19,064 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=6774bd4b3819baff6ad609f7188c1ad0-a6b83f2ce9f7477485192db429c782d2 2023-02-17 18:01:19,064 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:19,065 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=6774bd4b3819baff6ad609f7188c1ad0-d6348719063d452b8a75432e33ac1890 2023-02-17 18:01:19,065 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------96b58084280324f52a9759d84ee12306/ 2023-02-17 18:01:19,065 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,065 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:19,066 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=96b58084280324f52a9759d84ee12306-716c4128bc7e4ed4bd09a274244bb059 2023-02-17 18:01:19,066 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:19,066 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=96b58084280324f52a9759d84ee12306-bbba70394cf448fe934710b165444be5 2023-02-17 18:01:19,067 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------c5494d2cbfab0772cd8ed47e2da3b4b2/ 2023-02-17 18:01:19,067 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,067 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:19,068 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=c5494d2cbfab0772cd8ed47e2da3b4b2-91bea2be4a0d4e1d8e35b5ef8aeb5f0e 2023-02-17 18:01:19,068 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:19,068 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=c5494d2cbfab0772cd8ed47e2da3b4b2-be2c24fa8bf646569164554d4e65be06 2023-02-17 18:01:19,068 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------df7397fff874739e2928157f9cc3d2a0/ 2023-02-17 18:01:19,069 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,069 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------e2c3d4afab922c1be50962ad98bc41da/ 2023-02-17 18:01:19,069 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,069 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:19,070 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=e2c3d4afab922c1be50962ad98bc41da-1d2c681500db4af681bdff60a153f052 2023-02-17 18:01:19,070 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:19,070 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=e2c3d4afab922c1be50962ad98bc41da-b81c1d01bf8e49d68a210e0c910fece1 2023-02-17 18:01:19,070 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------ed443a661d7e295cf386652efe912178/ 2023-02-17 18:01:19,071 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,071 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:19,071 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=ed443a661d7e295cf386652efe912178-b852be2d1b8946c0aa1f102b8698f85f 2023-02-17 18:01:19,071 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:19,072 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |----------------testWithMapReduce=ed443a661d7e295cf386652efe912178-532de90553cd4c6ba920e1850183ce88 2023-02-17 18:01:19,072 DEBUG [Listener at localhost/36077] util.CommonFSUtils(699): |----------f3e1b299e5de21dbb1cd167717a4fd6c/ 2023-02-17 18:01:19,072 DEBUG [Listener at localhost/36077] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:19,081 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,081 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,082 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,082 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,082 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,083 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,083 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,151 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/hadoop-1246504905255064949.jar 2023-02-17 18:01:19,152 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,152 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,153 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,153 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,153 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,154 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,154 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-17 18:01:19,155 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-17 18:01:19,155 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-17 18:01:19,156 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-17 18:01:19,156 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-17 18:01:19,157 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-17 18:01:19,157 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-17 18:01:19,157 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-17 18:01:19,158 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-17 18:01:19,158 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-17 18:01:19,164 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:19,164 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 18:01:19,164 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 18:01:19,165 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 18:01:19,165 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 18:01:19,234 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/hadoop-1759858725346072679.jar 2023-02-17 18:01:19,235 DEBUG [Listener at localhost/36077] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 18:01:19,285 WARN [Listener at localhost/36077] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-17 18:01:19,349 INFO [Listener at localhost/36077] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 18:01:19,792 WARN [Listener at localhost/36077] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/mapreduce.cluster.local.dir/1676656879704/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-17 18:01:19,792 WARN [Listener at localhost/36077] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/mapreduce.cluster.local.dir/1676656879704/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-17 18:01:19,948 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:19,948 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:19,950 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:19,953 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:19,955 DEBUG [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1 2023-02-17 18:01:19,955 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5494d2cbfab0772cd8ed47e2da3b4b2 columnFamilyName f1 2023-02-17 18:01:19,967 DEBUG [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/testWithMapReduce=c5494d2cbfab0772cd8ed47e2da3b4b2-91bea2be4a0d4e1d8e35b5ef8aeb5f0e 2023-02-17 18:01:19,968 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(310): Store=c5494d2cbfab0772cd8ed47e2da3b4b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:19,968 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:19,969 DEBUG [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2 2023-02-17 18:01:19,969 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5494d2cbfab0772cd8ed47e2da3b4b2 columnFamilyName f2 2023-02-17 18:01:19,975 DEBUG [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/testWithMapReduce=c5494d2cbfab0772cd8ed47e2da3b4b2-be2c24fa8bf646569164554d4e65be06 2023-02-17 18:01:19,975 INFO [StoreOpener-c5494d2cbfab0772cd8ed47e2da3b4b2-1] regionserver.HStore(310): Store=c5494d2cbfab0772cd8ed47e2da3b4b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:19,976 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:19,976 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c5494d2cbfab0772cd8ed47e2da3b4b2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62690306, jitterRate=-0.06584164500236511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:19,976 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c5494d2cbfab0772cd8ed47e2da3b4b2: 2023-02-17 18:01:20,147 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c5494d2cbfab0772cd8ed47e2da3b4b2, disabling compactions & flushes 2023-02-17 18:01:20,147 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:20,147 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:20,147 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. after waiting 0 ms 2023-02-17 18:01:20,147 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:20,153 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:20,153 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c5494d2cbfab0772cd8ed47e2da3b4b2: 2023-02-17 18:01:20,165 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:20,165 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:20,166 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:20,172 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:20,174 DEBUG [StoreOpener-96b58084280324f52a9759d84ee12306-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1 2023-02-17 18:01:20,174 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96b58084280324f52a9759d84ee12306 columnFamilyName f1 2023-02-17 18:01:20,185 DEBUG [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/testWithMapReduce=96b58084280324f52a9759d84ee12306-716c4128bc7e4ed4bd09a274244bb059 2023-02-17 18:01:20,185 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(310): Store=96b58084280324f52a9759d84ee12306/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,185 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:20,186 DEBUG [StoreOpener-96b58084280324f52a9759d84ee12306-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2 2023-02-17 18:01:20,186 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96b58084280324f52a9759d84ee12306 columnFamilyName f2 2023-02-17 18:01:20,193 DEBUG [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/testWithMapReduce=96b58084280324f52a9759d84ee12306-bbba70394cf448fe934710b165444be5 2023-02-17 18:01:20,193 INFO [StoreOpener-96b58084280324f52a9759d84ee12306-1] regionserver.HStore(310): Store=96b58084280324f52a9759d84ee12306/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:20,194 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 96b58084280324f52a9759d84ee12306; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60698329, jitterRate=-0.09552441537380219}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:20,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 96b58084280324f52a9759d84ee12306: 2023-02-17 18:01:20,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 96b58084280324f52a9759d84ee12306, disabling compactions & flushes 2023-02-17 18:01:20,266 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:20,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:20,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. after waiting 0 ms 2023-02-17 18:01:20,266 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:20,279 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:20,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 96b58084280324f52a9759d84ee12306: 2023-02-17 18:01:20,285 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:20,285 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:20,291 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:20,299 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:20,301 DEBUG [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/f1 2023-02-17 18:01:20,302 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df7397fff874739e2928157f9cc3d2a0 columnFamilyName f1 2023-02-17 18:01:20,303 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] regionserver.HStore(310): Store=df7397fff874739e2928157f9cc3d2a0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,303 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:20,306 DEBUG [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/f2 2023-02-17 18:01:20,306 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df7397fff874739e2928157f9cc3d2a0 columnFamilyName f2 2023-02-17 18:01:20,307 INFO [StoreOpener-df7397fff874739e2928157f9cc3d2a0-1] regionserver.HStore(310): Store=df7397fff874739e2928157f9cc3d2a0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:20,307 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened df7397fff874739e2928157f9cc3d2a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68513557, jitterRate=0.020931556820869446}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:20,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for df7397fff874739e2928157f9cc3d2a0: 2023-02-17 18:01:20,326 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing df7397fff874739e2928157f9cc3d2a0, disabling compactions & flushes 2023-02-17 18:01:20,327 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:20,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:20,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. after waiting 0 ms 2023-02-17 18:01:20,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:20,328 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:20,328 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for df7397fff874739e2928157f9cc3d2a0: 2023-02-17 18:01:20,334 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:20,334 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:20,335 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:20,340 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:20,341 DEBUG [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1 2023-02-17 18:01:20,341 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34459a93abdbe75d8f607201b16b0317 columnFamilyName f1 2023-02-17 18:01:20,348 DEBUG [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/testWithMapReduce=34459a93abdbe75d8f607201b16b0317-4053cc4771374f4db70fd4abef4a8d57 2023-02-17 18:01:20,348 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(310): Store=34459a93abdbe75d8f607201b16b0317/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,348 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:20,349 DEBUG [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2 2023-02-17 18:01:20,349 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34459a93abdbe75d8f607201b16b0317 columnFamilyName f2 2023-02-17 18:01:20,357 DEBUG [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/testWithMapReduce=34459a93abdbe75d8f607201b16b0317-15cf6e1bff074359a062cd59da36d007 2023-02-17 18:01:20,357 INFO [StoreOpener-34459a93abdbe75d8f607201b16b0317-1] regionserver.HStore(310): Store=34459a93abdbe75d8f607201b16b0317/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,357 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:20,358 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 34459a93abdbe75d8f607201b16b0317; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62192013, jitterRate=-0.07326678931713104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:20,358 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 34459a93abdbe75d8f607201b16b0317: 2023-02-17 18:01:20,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 34459a93abdbe75d8f607201b16b0317, disabling compactions & flushes 2023-02-17 18:01:20,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:20,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:20,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. after waiting 0 ms 2023-02-17 18:01:20,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:20,453 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:20,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 34459a93abdbe75d8f607201b16b0317: 2023-02-17 18:01:20,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:20,459 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:20,464 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:20,466 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:20,467 DEBUG [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1 2023-02-17 18:01:20,468 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4bed7d34e697192bd3b7561af0bb94e2 columnFamilyName f1 2023-02-17 18:01:20,476 DEBUG [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/testWithMapReduce=4bed7d34e697192bd3b7561af0bb94e2-2904877d0d60457aa6c4e2ba3d624766 2023-02-17 18:01:20,476 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(310): Store=4bed7d34e697192bd3b7561af0bb94e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,476 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:20,477 DEBUG [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2 2023-02-17 18:01:20,478 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4bed7d34e697192bd3b7561af0bb94e2 columnFamilyName f2 2023-02-17 18:01:20,484 DEBUG [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/testWithMapReduce=4bed7d34e697192bd3b7561af0bb94e2-9fbcb27120724989987c49f0ea68af36 2023-02-17 18:01:20,484 INFO [StoreOpener-4bed7d34e697192bd3b7561af0bb94e2-1] regionserver.HStore(310): Store=4bed7d34e697192bd3b7561af0bb94e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,485 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:20,485 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4bed7d34e697192bd3b7561af0bb94e2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60002275, jitterRate=-0.10589642822742462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:20,485 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4bed7d34e697192bd3b7561af0bb94e2: 2023-02-17 18:01:20,523 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4bed7d34e697192bd3b7561af0bb94e2, disabling compactions & flushes 2023-02-17 18:01:20,523 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:20,523 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:20,523 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. after waiting 0 ms 2023-02-17 18:01:20,523 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:20,527 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:20,527 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4bed7d34e697192bd3b7561af0bb94e2: 2023-02-17 18:01:20,532 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:20,532 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:20,533 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:20,535 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:20,536 DEBUG [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1 2023-02-17 18:01:20,537 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2c3d4afab922c1be50962ad98bc41da columnFamilyName f1 2023-02-17 18:01:20,549 DEBUG [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/testWithMapReduce=e2c3d4afab922c1be50962ad98bc41da-1d2c681500db4af681bdff60a153f052 2023-02-17 18:01:20,549 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(310): Store=e2c3d4afab922c1be50962ad98bc41da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,549 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:20,551 DEBUG [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2 2023-02-17 18:01:20,551 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2c3d4afab922c1be50962ad98bc41da columnFamilyName f2 2023-02-17 18:01:20,567 DEBUG [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/testWithMapReduce=e2c3d4afab922c1be50962ad98bc41da-b81c1d01bf8e49d68a210e0c910fece1 2023-02-17 18:01:20,567 INFO [StoreOpener-e2c3d4afab922c1be50962ad98bc41da-1] regionserver.HStore(310): Store=e2c3d4afab922c1be50962ad98bc41da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:20,568 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e2c3d4afab922c1be50962ad98bc41da; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73331397, jitterRate=0.09272296726703644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:20,568 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e2c3d4afab922c1be50962ad98bc41da: 2023-02-17 18:01:20,606 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e2c3d4afab922c1be50962ad98bc41da, disabling compactions & flushes 2023-02-17 18:01:20,606 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:20,606 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:20,607 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. after waiting 0 ms 2023-02-17 18:01:20,607 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:20,612 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:20,612 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e2c3d4afab922c1be50962ad98bc41da: 2023-02-17 18:01:20,617 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:20,617 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:20,625 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:20,636 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:20,637 DEBUG [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1 2023-02-17 18:01:20,638 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 668b8c0def8ac669c2322b0032ccb53c columnFamilyName f1 2023-02-17 18:01:20,646 DEBUG [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/testWithMapReduce=668b8c0def8ac669c2322b0032ccb53c-6cfda25d9fc24ab19fd9d20de62a7f9e 2023-02-17 18:01:20,647 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(310): Store=668b8c0def8ac669c2322b0032ccb53c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,647 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:20,648 DEBUG [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2 2023-02-17 18:01:20,648 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 668b8c0def8ac669c2322b0032ccb53c columnFamilyName f2 2023-02-17 18:01:20,654 DEBUG [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/testWithMapReduce=668b8c0def8ac669c2322b0032ccb53c-0b0b60a2a7454fce9dd5c91932f8b727 2023-02-17 18:01:20,654 INFO [StoreOpener-668b8c0def8ac669c2322b0032ccb53c-1] regionserver.HStore(310): Store=668b8c0def8ac669c2322b0032ccb53c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,654 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:20,654 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 668b8c0def8ac669c2322b0032ccb53c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65030484, jitterRate=-0.030970275402069092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:20,654 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 668b8c0def8ac669c2322b0032ccb53c: 2023-02-17 18:01:20,699 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 668b8c0def8ac669c2322b0032ccb53c, disabling compactions & flushes 2023-02-17 18:01:20,699 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:20,699 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:20,699 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. after waiting 0 ms 2023-02-17 18:01:20,699 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:20,703 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:20,703 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 668b8c0def8ac669c2322b0032ccb53c: 2023-02-17 18:01:20,709 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:20,709 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:20,711 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:20,731 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:20,733 DEBUG [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1 2023-02-17 18:01:20,734 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6774bd4b3819baff6ad609f7188c1ad0 columnFamilyName f1 2023-02-17 18:01:20,742 DEBUG [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/testWithMapReduce=6774bd4b3819baff6ad609f7188c1ad0-a6b83f2ce9f7477485192db429c782d2 2023-02-17 18:01:20,742 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(310): Store=6774bd4b3819baff6ad609f7188c1ad0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,742 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:20,743 DEBUG [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2 2023-02-17 18:01:20,744 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6774bd4b3819baff6ad609f7188c1ad0 columnFamilyName f2 2023-02-17 18:01:20,750 DEBUG [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/testWithMapReduce=6774bd4b3819baff6ad609f7188c1ad0-d6348719063d452b8a75432e33ac1890 2023-02-17 18:01:20,750 INFO [StoreOpener-6774bd4b3819baff6ad609f7188c1ad0-1] regionserver.HStore(310): Store=6774bd4b3819baff6ad609f7188c1ad0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:20,751 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6774bd4b3819baff6ad609f7188c1ad0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69253199, jitterRate=0.031953081488609314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:20,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6774bd4b3819baff6ad609f7188c1ad0: 2023-02-17 18:01:20,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6774bd4b3819baff6ad609f7188c1ad0, disabling compactions & flushes 2023-02-17 18:01:20,789 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:20,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:20,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. after waiting 0 ms 2023-02-17 18:01:20,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:20,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:20,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6774bd4b3819baff6ad609f7188c1ad0: 2023-02-17 18:01:20,798 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:20,798 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:20,801 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:20,802 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ed443a661d7e295cf386652efe912178 2023-02-17 18:01:20,803 DEBUG [StoreOpener-ed443a661d7e295cf386652efe912178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1 2023-02-17 18:01:20,804 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed443a661d7e295cf386652efe912178 columnFamilyName f1 2023-02-17 18:01:20,809 DEBUG [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/testWithMapReduce=ed443a661d7e295cf386652efe912178-b852be2d1b8946c0aa1f102b8698f85f 2023-02-17 18:01:20,810 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(310): Store=ed443a661d7e295cf386652efe912178/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,810 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ed443a661d7e295cf386652efe912178 2023-02-17 18:01:20,811 DEBUG [StoreOpener-ed443a661d7e295cf386652efe912178-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2 2023-02-17 18:01:20,811 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed443a661d7e295cf386652efe912178 columnFamilyName f2 2023-02-17 18:01:20,816 DEBUG [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(539): loaded hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/testWithMapReduce=ed443a661d7e295cf386652efe912178-532de90553cd4c6ba920e1850183ce88 2023-02-17 18:01:20,816 INFO [StoreOpener-ed443a661d7e295cf386652efe912178-1] regionserver.HStore(310): Store=ed443a661d7e295cf386652efe912178/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:20,817 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ed443a661d7e295cf386652efe912178; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73384289, jitterRate=0.09351111948490143}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:20,817 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ed443a661d7e295cf386652efe912178: 2023-02-17 18:01:20,876 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ed443a661d7e295cf386652efe912178, disabling compactions & flushes 2023-02-17 18:01:20,876 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:20,876 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:20,876 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. after waiting 0 ms 2023-02-17 18:01:20,876 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:20,879 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:20,879 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ed443a661d7e295cf386652efe912178: 2023-02-17 18:01:20,883 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:20,884 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:20,885 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:20,887 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:20,888 DEBUG [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/f1 2023-02-17 18:01:20,889 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3e1b299e5de21dbb1cd167717a4fd6c columnFamilyName f1 2023-02-17 18:01:20,889 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] regionserver.HStore(310): Store=f3e1b299e5de21dbb1cd167717a4fd6c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,889 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:20,891 DEBUG [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37141/user/jenkins/test-data/c77c6f4f-1ea5-e771-dbf2-d3e94171dc28/testWithMapReduceMultiRegion/f591a792-57c9-4d03-9871-1bddf4541bfa/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/f2 2023-02-17 18:01:20,891 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3e1b299e5de21dbb1cd167717a4fd6c columnFamilyName f2 2023-02-17 18:01:20,892 INFO [StoreOpener-f3e1b299e5de21dbb1cd167717a4fd6c-1] regionserver.HStore(310): Store=f3e1b299e5de21dbb1cd167717a4fd6c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:20,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:20,892 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f3e1b299e5de21dbb1cd167717a4fd6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62426741, jitterRate=-0.06976906955242157}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:20,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f3e1b299e5de21dbb1cd167717a4fd6c: 2023-02-17 18:01:20,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f3e1b299e5de21dbb1cd167717a4fd6c, disabling compactions & flushes 2023-02-17 18:01:20,909 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:20,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:20,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. after waiting 0 ms 2023-02-17 18:01:20,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:20,910 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:20,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f3e1b299e5de21dbb1cd167717a4fd6c: 2023-02-17 18:01:21,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-17 18:01:21,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-17 18:01:21,882 INFO [Listener at localhost/36077] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 18:01:21,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 18:01:21,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-17 18:01:21,893 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656881892"}]},"ts":"1676656881892"} 2023-02-17 18:01:21,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 18:01:21,895 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-17 18:01:21,897 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-17 18:01:21,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=df7397fff874739e2928157f9cc3d2a0, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ed443a661d7e295cf386652efe912178, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=34459a93abdbe75d8f607201b16b0317, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=96b58084280324f52a9759d84ee12306, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4bed7d34e697192bd3b7561af0bb94e2, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=668b8c0def8ac669c2322b0032ccb53c, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6774bd4b3819baff6ad609f7188c1ad0, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e2c3d4afab922c1be50962ad98bc41da, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c5494d2cbfab0772cd8ed47e2da3b4b2, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f3e1b299e5de21dbb1cd167717a4fd6c, UNASSIGN}] 2023-02-17 18:01:21,902 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c5494d2cbfab0772cd8ed47e2da3b4b2, UNASSIGN 2023-02-17 18:01:21,902 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e2c3d4afab922c1be50962ad98bc41da, UNASSIGN 2023-02-17 18:01:21,902 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6774bd4b3819baff6ad609f7188c1ad0, UNASSIGN 2023-02-17 18:01:21,903 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f3e1b299e5de21dbb1cd167717a4fd6c, UNASSIGN 2023-02-17 18:01:21,903 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=668b8c0def8ac669c2322b0032ccb53c, UNASSIGN 2023-02-17 18:01:21,904 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=c5494d2cbfab0772cd8ed47e2da3b4b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:21,904 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e2c3d4afab922c1be50962ad98bc41da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:21,904 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656881904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881904"}]},"ts":"1676656881904"} 2023-02-17 18:01:21,904 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656881904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881904"}]},"ts":"1676656881904"} 2023-02-17 18:01:21,905 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6774bd4b3819baff6ad609f7188c1ad0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:21,905 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=668b8c0def8ac669c2322b0032ccb53c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:21,905 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f3e1b299e5de21dbb1cd167717a4fd6c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:21,905 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656881905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881905"}]},"ts":"1676656881905"} 2023-02-17 18:01:21,905 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656881905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881905"}]},"ts":"1676656881905"} 2023-02-17 18:01:21,905 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656881905"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881905"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881905"}]},"ts":"1676656881905"} 2023-02-17 18:01:21,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure c5494d2cbfab0772cd8ed47e2da3b4b2, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:21,907 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure e2c3d4afab922c1be50962ad98bc41da, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:21,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=40, state=RUNNABLE; CloseRegionProcedure 6774bd4b3819baff6ad609f7188c1ad0, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:21,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure f3e1b299e5de21dbb1cd167717a4fd6c, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:21,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure 668b8c0def8ac669c2322b0032ccb53c, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:21,924 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4bed7d34e697192bd3b7561af0bb94e2, UNASSIGN 2023-02-17 18:01:21,926 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=96b58084280324f52a9759d84ee12306, UNASSIGN 2023-02-17 18:01:21,926 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4bed7d34e697192bd3b7561af0bb94e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:21,926 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656881926"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881926"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881926"}]},"ts":"1676656881926"} 2023-02-17 18:01:21,927 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=34459a93abdbe75d8f607201b16b0317, UNASSIGN 2023-02-17 18:01:21,929 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=96b58084280324f52a9759d84ee12306, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:21,929 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676656873810.96b58084280324f52a9759d84ee12306.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656881928"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881928"}]},"ts":"1676656881928"} 2023-02-17 18:01:21,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure 4bed7d34e697192bd3b7561af0bb94e2, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:21,930 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=34459a93abdbe75d8f607201b16b0317, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:21,930 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656881930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881930"}]},"ts":"1676656881930"} 2023-02-17 18:01:21,931 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ed443a661d7e295cf386652efe912178, UNASSIGN 2023-02-17 18:01:21,931 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=df7397fff874739e2928157f9cc3d2a0, UNASSIGN 2023-02-17 18:01:21,932 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ed443a661d7e295cf386652efe912178, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:21,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 96b58084280324f52a9759d84ee12306, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:21,932 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656881932"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881932"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881932"}]},"ts":"1676656881932"} 2023-02-17 18:01:21,932 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=df7397fff874739e2928157f9cc3d2a0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:21,933 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656881932"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656881932"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656881932"}]},"ts":"1676656881932"} 2023-02-17 18:01:21,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 34459a93abdbe75d8f607201b16b0317, server=jenkins-hbase4.apache.org,40417,1676656869914}] 2023-02-17 18:01:21,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure ed443a661d7e295cf386652efe912178, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:21,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure df7397fff874739e2928157f9cc3d2a0, server=jenkins-hbase4.apache.org,40351,1676656869964}] 2023-02-17 18:01:21,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 18:01:22,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:22,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 668b8c0def8ac669c2322b0032ccb53c, disabling compactions & flushes 2023-02-17 18:01:22,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:22,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:22,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6774bd4b3819baff6ad609f7188c1ad0, disabling compactions & flushes 2023-02-17 18:01:22,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:22,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:22,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. after waiting 0 ms 2023-02-17 18:01:22,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:22,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:22,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. after waiting 0 ms 2023-02-17 18:01:22,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:22,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:22,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c. 2023-02-17 18:01:22,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 668b8c0def8ac669c2322b0032ccb53c: 2023-02-17 18:01:22,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:22,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:22,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c5494d2cbfab0772cd8ed47e2da3b4b2, disabling compactions & flushes 2023-02-17 18:01:22,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:22,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:22,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. after waiting 0 ms 2023-02-17 18:01:22,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:22,095 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=668b8c0def8ac669c2322b0032ccb53c, regionState=CLOSED 2023-02-17 18:01:22,095 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656882095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882095"}]},"ts":"1676656882095"} 2023-02-17 18:01:22,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-17 18:01:22,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure 668b8c0def8ac669c2322b0032ccb53c, server=jenkins-hbase4.apache.org,40417,1676656869914 in 187 msec 2023-02-17 18:01:22,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=668b8c0def8ac669c2322b0032ccb53c, UNASSIGN in 201 msec 2023-02-17 18:01:22,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:22,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0. 2023-02-17 18:01:22,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6774bd4b3819baff6ad609f7188c1ad0: 2023-02-17 18:01:22,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:22,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ed443a661d7e295cf386652efe912178 2023-02-17 18:01:22,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ed443a661d7e295cf386652efe912178, disabling compactions & flushes 2023-02-17 18:01:22,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:22,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:22,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. after waiting 0 ms 2023-02-17 18:01:22,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:22,114 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6774bd4b3819baff6ad609f7188c1ad0, regionState=CLOSED 2023-02-17 18:01:22,115 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656882114"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882114"}]},"ts":"1676656882114"} 2023-02-17 18:01:22,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=40 2023-02-17 18:01:22,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=40, state=SUCCESS; CloseRegionProcedure 6774bd4b3819baff6ad609f7188c1ad0, server=jenkins-hbase4.apache.org,40351,1676656869964 in 209 msec 2023-02-17 18:01:22,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:22,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6774bd4b3819baff6ad609f7188c1ad0, UNASSIGN in 224 msec 2023-02-17 18:01:22,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2. 2023-02-17 18:01:22,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c5494d2cbfab0772cd8ed47e2da3b4b2: 2023-02-17 18:01:22,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:22,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:22,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e2c3d4afab922c1be50962ad98bc41da, disabling compactions & flushes 2023-02-17 18:01:22,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:22,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:22,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. after waiting 0 ms 2023-02-17 18:01:22,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:22,128 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=c5494d2cbfab0772cd8ed47e2da3b4b2, regionState=CLOSED 2023-02-17 18:01:22,128 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656882128"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882128"}]},"ts":"1676656882128"} 2023-02-17 18:01:22,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-02-17 18:01:22,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure c5494d2cbfab0772cd8ed47e2da3b4b2, server=jenkins-hbase4.apache.org,40417,1676656869914 in 223 msec 2023-02-17 18:01:22,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c5494d2cbfab0772cd8ed47e2da3b4b2, UNASSIGN in 232 msec 2023-02-17 18:01:22,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:22,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178. 2023-02-17 18:01:22,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ed443a661d7e295cf386652efe912178: 2023-02-17 18:01:22,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ed443a661d7e295cf386652efe912178 2023-02-17 18:01:22,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:22,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4bed7d34e697192bd3b7561af0bb94e2, disabling compactions & flushes 2023-02-17 18:01:22,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:22,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:22,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. after waiting 0 ms 2023-02-17 18:01:22,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:22,147 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=ed443a661d7e295cf386652efe912178, regionState=CLOSED 2023-02-17 18:01:22,148 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656882147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882147"}]},"ts":"1676656882147"} 2023-02-17 18:01:22,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:22,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da. 2023-02-17 18:01:22,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e2c3d4afab922c1be50962ad98bc41da: 2023-02-17 18:01:22,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:22,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:22,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 34459a93abdbe75d8f607201b16b0317, disabling compactions & flushes 2023-02-17 18:01:22,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:22,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:22,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. after waiting 0 ms 2023-02-17 18:01:22,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:22,154 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e2c3d4afab922c1be50962ad98bc41da, regionState=CLOSED 2023-02-17 18:01:22,154 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656882154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882154"}]},"ts":"1676656882154"} 2023-02-17 18:01:22,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-17 18:01:22,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure ed443a661d7e295cf386652efe912178, server=jenkins-hbase4.apache.org,40351,1676656869964 in 213 msec 2023-02-17 18:01:22,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:22,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ed443a661d7e295cf386652efe912178, UNASSIGN in 257 msec 2023-02-17 18:01:22,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2. 2023-02-17 18:01:22,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4bed7d34e697192bd3b7561af0bb94e2: 2023-02-17 18:01:22,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-17 18:01:22,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure e2c3d4afab922c1be50962ad98bc41da, server=jenkins-hbase4.apache.org,40417,1676656869914 in 249 msec 2023-02-17 18:01:22,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:22,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e2c3d4afab922c1be50962ad98bc41da, UNASSIGN in 267 msec 2023-02-17 18:01:22,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317. 2023-02-17 18:01:22,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 34459a93abdbe75d8f607201b16b0317: 2023-02-17 18:01:22,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:22,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:22,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing df7397fff874739e2928157f9cc3d2a0, disabling compactions & flushes 2023-02-17 18:01:22,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:22,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:22,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. after waiting 0 ms 2023-02-17 18:01:22,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:22,169 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4bed7d34e697192bd3b7561af0bb94e2, regionState=CLOSED 2023-02-17 18:01:22,169 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656882169"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882169"}]},"ts":"1676656882169"} 2023-02-17 18:01:22,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:22,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:22,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 96b58084280324f52a9759d84ee12306, disabling compactions & flushes 2023-02-17 18:01:22,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:22,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:22,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. after waiting 0 ms 2023-02-17 18:01:22,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:22,171 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=34459a93abdbe75d8f607201b16b0317, regionState=CLOSED 2023-02-17 18:01:22,171 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656882171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882171"}]},"ts":"1676656882171"} 2023-02-17 18:01:22,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 18:01:22,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-17 18:01:22,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure 4bed7d34e697192bd3b7561af0bb94e2, server=jenkins-hbase4.apache.org,40351,1676656869964 in 242 msec 2023-02-17 18:01:22,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0. 2023-02-17 18:01:22,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for df7397fff874739e2928157f9cc3d2a0: 2023-02-17 18:01:22,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4bed7d34e697192bd3b7561af0bb94e2, UNASSIGN in 276 msec 2023-02-17 18:01:22,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:22,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:22,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-17 18:01:22,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f3e1b299e5de21dbb1cd167717a4fd6c, disabling compactions & flushes 2023-02-17 18:01:22,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 34459a93abdbe75d8f607201b16b0317, server=jenkins-hbase4.apache.org,40417,1676656869914 in 239 msec 2023-02-17 18:01:22,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:22,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:22,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. after waiting 0 ms 2023-02-17 18:01:22,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:22,178 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=df7397fff874739e2928157f9cc3d2a0, regionState=CLOSED 2023-02-17 18:01:22,178 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656882178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882178"}]},"ts":"1676656882178"} 2023-02-17 18:01:22,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=34459a93abdbe75d8f607201b16b0317, UNASSIGN in 279 msec 2023-02-17 18:01:22,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-17 18:01:22,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure df7397fff874739e2928157f9cc3d2a0, server=jenkins-hbase4.apache.org,40351,1676656869964 in 243 msec 2023-02-17 18:01:22,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=df7397fff874739e2928157f9cc3d2a0, UNASSIGN in 284 msec 2023-02-17 18:01:22,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 18:01:22,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c. 2023-02-17 18:01:22,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:22,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f3e1b299e5de21dbb1cd167717a4fd6c: 2023-02-17 18:01:22,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306. 2023-02-17 18:01:22,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 96b58084280324f52a9759d84ee12306: 2023-02-17 18:01:22,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:22,195 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f3e1b299e5de21dbb1cd167717a4fd6c, regionState=CLOSED 2023-02-17 18:01:22,195 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656882195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882195"}]},"ts":"1676656882195"} 2023-02-17 18:01:22,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 96b58084280324f52a9759d84ee12306 2023-02-17 18:01:22,196 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=96b58084280324f52a9759d84ee12306, regionState=CLOSED 2023-02-17 18:01:22,196 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676656873810.96b58084280324f52a9759d84ee12306.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656882196"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656882196"}]},"ts":"1676656882196"} 2023-02-17 18:01:22,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 18:01:22,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-17 18:01:22,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure f3e1b299e5de21dbb1cd167717a4fd6c, server=jenkins-hbase4.apache.org,40351,1676656869964 in 287 msec 2023-02-17 18:01:22,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-17 18:01:22,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 96b58084280324f52a9759d84ee12306, server=jenkins-hbase4.apache.org,40417,1676656869914 in 266 msec 2023-02-17 18:01:22,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f3e1b299e5de21dbb1cd167717a4fd6c, UNASSIGN in 300 msec 2023-02-17 18:01:22,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=33 2023-02-17 18:01:22,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=96b58084280324f52a9759d84ee12306, UNASSIGN in 302 msec 2023-02-17 18:01:22,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656882203"}]},"ts":"1676656882203"} 2023-02-17 18:01:22,213 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-17 18:01:22,215 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-17 18:01:22,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 333 msec 2023-02-17 18:01:22,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 18:01:22,500 INFO [Listener at localhost/36077] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-17 18:01:22,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-17 18:01:22,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:01:22,513 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:01:22,514 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:01:22,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 18:01:22,531 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:22,531 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:22,531 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:22,531 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:22,531 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:22,531 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:22,531 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306 2023-02-17 18:01:22,531 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178 2023-02-17 18:01:22,538 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/recovered.edits] 2023-02-17 18:01:22,538 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/recovered.edits] 2023-02-17 18:01:22,539 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/recovered.edits] 2023-02-17 18:01:22,539 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/recovered.edits] 2023-02-17 18:01:22,540 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/recovered.edits] 2023-02-17 18:01:22,540 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/recovered.edits] 2023-02-17 18:01:22,540 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/recovered.edits] 2023-02-17 18:01:22,541 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/recovered.edits] 2023-02-17 18:01:22,556 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/7530a1d36fd748baa746e41f46565e4a to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/7530a1d36fd748baa746e41f46565e4a 2023-02-17 18:01:22,557 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/4053cc4771374f4db70fd4abef4a8d57 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/4053cc4771374f4db70fd4abef4a8d57 2023-02-17 18:01:22,557 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/716c4128bc7e4ed4bd09a274244bb059 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/716c4128bc7e4ed4bd09a274244bb059 2023-02-17 18:01:22,558 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/6cfda25d9fc24ab19fd9d20de62a7f9e to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/6cfda25d9fc24ab19fd9d20de62a7f9e 2023-02-17 18:01:22,558 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/2904877d0d60457aa6c4e2ba3d624766 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/2904877d0d60457aa6c4e2ba3d624766 2023-02-17 18:01:22,559 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/b852be2d1b8946c0aa1f102b8698f85f to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/b852be2d1b8946c0aa1f102b8698f85f 2023-02-17 18:01:22,560 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/02752c376d4f4e58a92b6296f31657be to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/02752c376d4f4e58a92b6296f31657be 2023-02-17 18:01:22,561 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/a6b83f2ce9f7477485192db429c782d2 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f1/a6b83f2ce9f7477485192db429c782d2 2023-02-17 18:01:22,562 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/df89fcb892b3437cb321c46e76570d2f to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f1/df89fcb892b3437cb321c46e76570d2f 2023-02-17 18:01:22,563 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/fb40bfb59fa64b4f8006b95ed913860a to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f1/fb40bfb59fa64b4f8006b95ed913860a 2023-02-17 18:01:22,563 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/ff414b7a464d43ccae50a299f35f33f9 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f1/ff414b7a464d43ccae50a299f35f33f9 2023-02-17 18:01:22,563 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/recovered.edits/6.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0/recovered.edits/6.seqid 2023-02-17 18:01:22,564 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/a16526943d4f4f80a5f8fedc10703ad1 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f1/a16526943d4f4f80a5f8fedc10703ad1 2023-02-17 18:01:22,566 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/e29a56fa189341a9a9582afd20cc35d1 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f1/e29a56fa189341a9a9582afd20cc35d1 2023-02-17 18:01:22,566 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/df7397fff874739e2928157f9cc3d2a0 2023-02-17 18:01:22,566 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/1d2c681500db4af681bdff60a153f052 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f1/1d2c681500db4af681bdff60a153f052 2023-02-17 18:01:22,566 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:22,571 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/666b13b67ca64ac895361de5d2bff22d to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/666b13b67ca64ac895361de5d2bff22d 2023-02-17 18:01:22,571 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/0b0b60a2a7454fce9dd5c91932f8b727 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/0b0b60a2a7454fce9dd5c91932f8b727 2023-02-17 18:01:22,572 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/recovered.edits] 2023-02-17 18:01:22,572 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/15cf6e1bff074359a062cd59da36d007 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/15cf6e1bff074359a062cd59da36d007 2023-02-17 18:01:22,576 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/9fbcb27120724989987c49f0ea68af36 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/9fbcb27120724989987c49f0ea68af36 2023-02-17 18:01:22,576 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/26f3f5a3a0b94e97a59d2726ad20b921 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/26f3f5a3a0b94e97a59d2726ad20b921 2023-02-17 18:01:22,577 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/f1c341929d8a4249ba033268abe9ee3c to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/f2/f1c341929d8a4249ba033268abe9ee3c 2023-02-17 18:01:22,577 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/aa8f7eef462746bea58f66c01e620d16 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/f2/aa8f7eef462746bea58f66c01e620d16 2023-02-17 18:01:22,578 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/d6348719063d452b8a75432e33ac1890 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/f2/d6348719063d452b8a75432e33ac1890 2023-02-17 18:01:22,578 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/50da5c2059264f83a542cc93224f70cd to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/50da5c2059264f83a542cc93224f70cd 2023-02-17 18:01:22,578 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/532de90553cd4c6ba920e1850183ce88 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/532de90553cd4c6ba920e1850183ce88 2023-02-17 18:01:22,581 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/bbba70394cf448fe934710b165444be5 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/f2/bbba70394cf448fe934710b165444be5 2023-02-17 18:01:22,581 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/c4340f500e944d89b404dc60b3d5dbcc to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/f2/c4340f500e944d89b404dc60b3d5dbcc 2023-02-17 18:01:22,582 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/b81c1d01bf8e49d68a210e0c910fece1 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/f2/b81c1d01bf8e49d68a210e0c910fece1 2023-02-17 18:01:22,583 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/edb19dd42a724d19904df516d74f40ac to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/f2/edb19dd42a724d19904df516d74f40ac 2023-02-17 18:01:22,586 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/8a79df65a3524e8e8a229db320be7542 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/8a79df65a3524e8e8a229db320be7542 2023-02-17 18:01:22,587 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/recovered.edits/12.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317/recovered.edits/12.seqid 2023-02-17 18:01:22,588 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/34459a93abdbe75d8f607201b16b0317 2023-02-17 18:01:22,588 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:22,590 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/recovered.edits/12.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c/recovered.edits/12.seqid 2023-02-17 18:01:22,591 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/recovered.edits/12.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0/recovered.edits/12.seqid 2023-02-17 18:01:22,591 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/recovered.edits/12.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306/recovered.edits/12.seqid 2023-02-17 18:01:22,591 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/91bea2be4a0d4e1d8e35b5ef8aeb5f0e to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f1/91bea2be4a0d4e1d8e35b5ef8aeb5f0e 2023-02-17 18:01:22,592 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/668b8c0def8ac669c2322b0032ccb53c 2023-02-17 18:01:22,592 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/recovered.edits/12.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2/recovered.edits/12.seqid 2023-02-17 18:01:22,594 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/96b58084280324f52a9759d84ee12306 2023-02-17 18:01:22,594 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/6774bd4b3819baff6ad609f7188c1ad0 2023-02-17 18:01:22,594 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/4bed7d34e697192bd3b7561af0bb94e2 2023-02-17 18:01:22,595 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/f1, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/f2, FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/recovered.edits] 2023-02-17 18:01:22,595 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/recovered.edits/12.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178/recovered.edits/12.seqid 2023-02-17 18:01:22,596 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/recovered.edits/12.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da/recovered.edits/12.seqid 2023-02-17 18:01:22,596 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/ed443a661d7e295cf386652efe912178 2023-02-17 18:01:22,597 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/e2c3d4afab922c1be50962ad98bc41da 2023-02-17 18:01:22,600 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/13eadc69589e450db398593a6e5944e8 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/13eadc69589e450db398593a6e5944e8 2023-02-17 18:01:22,603 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/be2c24fa8bf646569164554d4e65be06 to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/f2/be2c24fa8bf646569164554d4e65be06 2023-02-17 18:01:22,606 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/recovered.edits/6.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c/recovered.edits/6.seqid 2023-02-17 18:01:22,607 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/f3e1b299e5de21dbb1cd167717a4fd6c 2023-02-17 18:01:22,609 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/recovered.edits/12.seqid to hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/archive/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2/recovered.edits/12.seqid 2023-02-17 18:01:22,610 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/.tmp/data/default/testWithMapReduce/c5494d2cbfab0772cd8ed47e2da3b4b2 2023-02-17 18:01:22,610 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 18:01:22,613 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:01:22,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 18:01:22,646 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-17 18:01:22,650 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-17 18:01:22,652 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:01:22,652 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-17 18:01:22,653 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,653 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,653 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,653 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676656873810.96b58084280324f52a9759d84ee12306.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,653 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,653 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,653 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,653 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,654 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,654 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656882652"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,657 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-17 18:01:22,657 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => df7397fff874739e2928157f9cc3d2a0, NAME => 'testWithMapReduce,,1676656873810.df7397fff874739e2928157f9cc3d2a0.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => ed443a661d7e295cf386652efe912178, NAME => 'testWithMapReduce,aaa,1676656873810.ed443a661d7e295cf386652efe912178.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 34459a93abdbe75d8f607201b16b0317, NAME => 'testWithMapReduce,d\x84\x84,1676656873810.34459a93abdbe75d8f607201b16b0317.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 96b58084280324f52a9759d84ee12306, NAME => 'testWithMapReduce,g\xA7\xA7,1676656873810.96b58084280324f52a9759d84ee12306.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 4bed7d34e697192bd3b7561af0bb94e2, NAME => 'testWithMapReduce,j\xCA\xCA,1676656873810.4bed7d34e697192bd3b7561af0bb94e2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 668b8c0def8ac669c2322b0032ccb53c, NAME => 'testWithMapReduce,m\xED\xED,1676656873810.668b8c0def8ac669c2322b0032ccb53c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 6774bd4b3819baff6ad609f7188c1ad0, NAME => 'testWithMapReduce,q\x11\x10,1676656873810.6774bd4b3819baff6ad609f7188c1ad0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => e2c3d4afab922c1be50962ad98bc41da, NAME => 'testWithMapReduce,t43,1676656873810.e2c3d4afab922c1be50962ad98bc41da.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => c5494d2cbfab0772cd8ed47e2da3b4b2, NAME => 'testWithMapReduce,wWV,1676656873810.c5494d2cbfab0772cd8ed47e2da3b4b2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => f3e1b299e5de21dbb1cd167717a4fd6c, NAME => 'testWithMapReduce,zz{,1676656873810.f3e1b299e5de21dbb1cd167717a4fd6c.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-17 18:01:22,657 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-17 18:01:22,658 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676656882658"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:22,662 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-17 18:01:22,664 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:01:22,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 159 msec 2023-02-17 18:01:22,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39369] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 18:01:22,820 INFO [Listener at localhost/36077] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-17 18:01:22,820 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 18:01:22,820 INFO [Listener at localhost/36077] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 18:01:22,820 DEBUG [Listener at localhost/36077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5baee36d to 127.0.0.1:54341 2023-02-17 18:01:22,820 DEBUG [Listener at localhost/36077] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:22,821 DEBUG [Listener at localhost/36077] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 18:01:22,821 DEBUG [Listener at localhost/36077] util.JVMClusterUtil(257): Found active master hash=490382526, stopped=false 2023-02-17 18:01:22,821 INFO [Listener at localhost/36077] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:22,828 INFO [Listener at localhost/36077] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 18:01:22,828 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:22,828 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:22,828 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:22,829 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:22,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:22,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:22,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:22,832 DEBUG [Listener at localhost/36077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2674ff2b to 127.0.0.1:54341 2023-02-17 18:01:22,832 DEBUG [Listener at localhost/36077] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:22,832 INFO [Listener at localhost/36077] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40417,1676656869914' ***** 2023-02-17 18:01:22,832 INFO [Listener at localhost/36077] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:22,832 INFO [Listener at localhost/36077] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40351,1676656869964' ***** 2023-02-17 18:01:22,833 INFO [Listener at localhost/36077] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:22,833 INFO [RS:1;jenkins-hbase4:40351] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:22,833 INFO [RS:1;jenkins-hbase4:40351] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:22,833 INFO [RS:1;jenkins-hbase4:40351] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:22,833 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(3304): Received CLOSE for d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:22,834 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:22,834 DEBUG [RS:1;jenkins-hbase4:40351] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bb3a543 to 127.0.0.1:54341 2023-02-17 18:01:22,834 DEBUG [RS:1;jenkins-hbase4:40351] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:22,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d012c65f939b7533387d7b159f66664b, disabling compactions & flushes 2023-02-17 18:01:22,834 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 18:01:22,834 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:22,834 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1479): Online Regions={d012c65f939b7533387d7b159f66664b=hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b.} 2023-02-17 18:01:22,834 INFO [RS:0;jenkins-hbase4:40417] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:22,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:22,835 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:22,835 INFO [RS:0;jenkins-hbase4:40417] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:22,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:22,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. after waiting 0 ms 2023-02-17 18:01:22,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:22,836 INFO [RS:0;jenkins-hbase4:40417] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:22,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing d012c65f939b7533387d7b159f66664b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 18:01:22,836 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:22,836 DEBUG [RS:0;jenkins-hbase4:40417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c3c26a2 to 127.0.0.1:54341 2023-02-17 18:01:22,837 DEBUG [RS:0;jenkins-hbase4:40417] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:22,837 INFO [RS:0;jenkins-hbase4:40417] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:22,837 INFO [RS:0;jenkins-hbase4:40417] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:22,837 INFO [RS:0;jenkins-hbase4:40417] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:22,837 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 18:01:22,837 DEBUG [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1505): Waiting on d012c65f939b7533387d7b159f66664b 2023-02-17 18:01:22,837 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 18:01:22,837 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-17 18:01:22,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:22,838 DEBUG [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 18:01:22,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:22,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:22,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:22,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:22,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-17 18:01:22,843 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:22,848 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:22,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b/.tmp/info/75ac0256e52d47ac956467d9fad741d0 2023-02-17 18:01:22,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b/.tmp/info/75ac0256e52d47ac956467d9fad741d0 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b/info/75ac0256e52d47ac956467d9fad741d0 2023-02-17 18:01:22,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/.tmp/info/2cbc9ea02d67419d882937958462092e 2023-02-17 18:01:22,881 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cbc9ea02d67419d882937958462092e 2023-02-17 18:01:22,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b/info/75ac0256e52d47ac956467d9fad741d0, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 18:01:22,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d012c65f939b7533387d7b159f66664b in 52ms, sequenceid=6, compaction requested=false 2023-02-17 18:01:22,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/.tmp/rep_barrier/56bb512300d54ddc98d8e5ee37ed4d0a 2023-02-17 18:01:22,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/namespace/d012c65f939b7533387d7b159f66664b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 18:01:22,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:22,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d012c65f939b7533387d7b159f66664b: 2023-02-17 18:01:22,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676656872931.d012c65f939b7533387d7b159f66664b. 2023-02-17 18:01:22,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56bb512300d54ddc98d8e5ee37ed4d0a 2023-02-17 18:01:22,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/.tmp/table/4e045e0cb53b400ab1b4188eb7c11f2b 2023-02-17 18:01:22,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e045e0cb53b400ab1b4188eb7c11f2b 2023-02-17 18:01:22,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/.tmp/info/2cbc9ea02d67419d882937958462092e as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/info/2cbc9ea02d67419d882937958462092e 2023-02-17 18:01:22,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cbc9ea02d67419d882937958462092e 2023-02-17 18:01:22,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/info/2cbc9ea02d67419d882937958462092e, entries=30, sequenceid=57, filesize=7.9 K 2023-02-17 18:01:22,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/.tmp/rep_barrier/56bb512300d54ddc98d8e5ee37ed4d0a as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/rep_barrier/56bb512300d54ddc98d8e5ee37ed4d0a 2023-02-17 18:01:22,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56bb512300d54ddc98d8e5ee37ed4d0a 2023-02-17 18:01:22,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/rep_barrier/56bb512300d54ddc98d8e5ee37ed4d0a, entries=10, sequenceid=57, filesize=5.9 K 2023-02-17 18:01:22,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/.tmp/table/4e045e0cb53b400ab1b4188eb7c11f2b as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/table/4e045e0cb53b400ab1b4188eb7c11f2b 2023-02-17 18:01:22,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e045e0cb53b400ab1b4188eb7c11f2b 2023-02-17 18:01:22,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/table/4e045e0cb53b400ab1b4188eb7c11f2b, entries=13, sequenceid=57, filesize=5.9 K 2023-02-17 18:01:22,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 146ms, sequenceid=57, compaction requested=false 2023-02-17 18:01:22,995 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-17 18:01:22,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 18:01:22,997 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:22,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:22,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:23,037 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40351,1676656869964; all regions closed. 2023-02-17 18:01:23,038 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40417,1676656869914; all regions closed. 2023-02-17 18:01:23,049 DEBUG [RS:0;jenkins-hbase4:40417] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/oldWALs 2023-02-17 18:01:23,049 DEBUG [RS:1;jenkins-hbase4:40351] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/oldWALs 2023-02-17 18:01:23,049 INFO [RS:1;jenkins-hbase4:40351] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40351%2C1676656869964:(num 1676656873383) 2023-02-17 18:01:23,049 INFO [RS:0;jenkins-hbase4:40417] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40417%2C1676656869914.meta:.meta(num 1676656872644) 2023-02-17 18:01:23,049 DEBUG [RS:1;jenkins-hbase4:40351] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:23,049 INFO [RS:1;jenkins-hbase4:40351] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:23,050 INFO [RS:1;jenkins-hbase4:40351] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:23,050 INFO [RS:1;jenkins-hbase4:40351] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:23,050 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:23,050 INFO [RS:1;jenkins-hbase4:40351] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:23,050 INFO [RS:1;jenkins-hbase4:40351] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:23,051 INFO [RS:1;jenkins-hbase4:40351] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40351 2023-02-17 18:01:23,059 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:23,059 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:23,059 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40351,1676656869964 2023-02-17 18:01:23,059 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:23,059 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:23,060 ERROR [Listener at localhost/36077-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@523fe050 rejected from java.util.concurrent.ThreadPoolExecutor@56006ecf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:23,060 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40351,1676656869964] 2023-02-17 18:01:23,060 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40351,1676656869964; numProcessing=1 2023-02-17 18:01:23,061 DEBUG [RS:0;jenkins-hbase4:40417] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/oldWALs 2023-02-17 18:01:23,061 INFO [RS:0;jenkins-hbase4:40417] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40417%2C1676656869914:(num 1676656873383) 2023-02-17 18:01:23,061 DEBUG [RS:0;jenkins-hbase4:40417] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:23,061 INFO [RS:0;jenkins-hbase4:40417] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:23,061 INFO [RS:0;jenkins-hbase4:40417] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:23,062 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:23,063 INFO [RS:0;jenkins-hbase4:40417] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40417 2023-02-17 18:01:23,063 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40351,1676656869964 already deleted, retry=false 2023-02-17 18:01:23,063 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40351,1676656869964 expired; onlineServers=1 2023-02-17 18:01:23,162 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:23,162 INFO [RS:1;jenkins-hbase4:40351] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40351,1676656869964; zookeeper connection closed. 2023-02-17 18:01:23,162 ERROR [Listener at localhost/36077-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fcbc049 rejected from java.util.concurrent.ThreadPoolExecutor@56006ecf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:23,162 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40351-0x100637163930002, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:23,162 ERROR [Listener at localhost/36077-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7778e812 rejected from java.util.concurrent.ThreadPoolExecutor@56006ecf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:23,166 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40417,1676656869914 2023-02-17 18:01:23,166 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:23,166 ERROR [Listener at localhost/36077-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55f9b2b7 rejected from java.util.concurrent.ThreadPoolExecutor@51c62cd0[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:23,166 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@452079ef] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@452079ef 2023-02-17 18:01:23,168 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40417,1676656869914] 2023-02-17 18:01:23,168 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40417,1676656869914; numProcessing=2 2023-02-17 18:01:23,169 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40417,1676656869914 already deleted, retry=false 2023-02-17 18:01:23,169 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40417,1676656869914 expired; onlineServers=0 2023-02-17 18:01:23,169 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39369,1676656868739' ***** 2023-02-17 18:01:23,169 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 18:01:23,170 DEBUG [M:0;jenkins-hbase4:39369] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c07ae85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:23,170 INFO [M:0;jenkins-hbase4:39369] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39369,1676656868739 2023-02-17 18:01:23,170 INFO [M:0;jenkins-hbase4:39369] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39369,1676656868739; all regions closed. 2023-02-17 18:01:23,170 DEBUG [M:0;jenkins-hbase4:39369] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:23,170 DEBUG [M:0;jenkins-hbase4:39369] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 18:01:23,170 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 18:01:23,170 DEBUG [M:0;jenkins-hbase4:39369] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 18:01:23,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656871153] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656871153,5,FailOnTimeoutGroup] 2023-02-17 18:01:23,170 INFO [M:0;jenkins-hbase4:39369] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 18:01:23,171 INFO [M:0;jenkins-hbase4:39369] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 18:01:23,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656871148] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656871148,5,FailOnTimeoutGroup] 2023-02-17 18:01:23,177 INFO [M:0;jenkins-hbase4:39369] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 18:01:23,177 DEBUG [M:0;jenkins-hbase4:39369] master.HMaster(1512): Stopping service threads 2023-02-17 18:01:23,177 INFO [M:0;jenkins-hbase4:39369] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 18:01:23,178 ERROR [M:0;jenkins-hbase4:39369] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-17 18:01:23,179 INFO [M:0;jenkins-hbase4:39369] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 18:01:23,179 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 18:01:23,268 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:23,269 INFO [RS:0;jenkins-hbase4:40417] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40417,1676656869914; zookeeper connection closed. 2023-02-17 18:01:23,269 ERROR [Listener at localhost/36077-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d6eeef3 rejected from java.util.concurrent.ThreadPoolExecutor@51c62cd0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:23,269 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@199fb56a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@199fb56a 2023-02-17 18:01:23,269 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): regionserver:40417-0x100637163930001, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:23,269 ERROR [Listener at localhost/36077-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@455a873c rejected from java.util.concurrent.ThreadPoolExecutor@51c62cd0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:23,269 INFO [Listener at localhost/36077] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 18:01:23,272 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:23,272 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:23,273 INFO [M:0;jenkins-hbase4:39369] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 18:01:23,273 INFO [M:0;jenkins-hbase4:39369] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 18:01:23,274 DEBUG [M:0;jenkins-hbase4:39369] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:23,274 INFO [M:0;jenkins-hbase4:39369] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:23,274 DEBUG [M:0;jenkins-hbase4:39369] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:23,274 DEBUG [M:0;jenkins-hbase4:39369] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:23,274 DEBUG [M:0;jenkins-hbase4:39369] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:23,274 INFO [M:0;jenkins-hbase4:39369] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.25 KB heapSize=192.19 KB 2023-02-17 18:01:23,280 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-02-17 18:01:23,280 DEBUG [RegionServerTracker-0] master.ActiveMasterManager(335): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-02-17 18:01:23,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:23,299 INFO [M:0;jenkins-hbase4:39369] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.25 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bf47df9fd7ee4791af6271da15da5cd5 2023-02-17 18:01:23,305 DEBUG [M:0;jenkins-hbase4:39369] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bf47df9fd7ee4791af6271da15da5cd5 as hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bf47df9fd7ee4791af6271da15da5cd5 2023-02-17 18:01:23,310 INFO [M:0;jenkins-hbase4:39369] regionserver.HStore(1080): Added hdfs://localhost:37141/user/jenkins/test-data/87574b17-d374-6f40-6a8d-5e24878dccf8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bf47df9fd7ee4791af6271da15da5cd5, entries=53, sequenceid=357, filesize=10.4 K 2023-02-17 18:01:23,311 INFO [M:0;jenkins-hbase4:39369] regionserver.HRegion(2947): Finished flush of dataSize ~159.25 KB/163075, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 37ms, sequenceid=357, compaction requested=false 2023-02-17 18:01:23,313 INFO [M:0;jenkins-hbase4:39369] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:23,313 DEBUG [M:0;jenkins-hbase4:39369] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:23,319 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:23,319 INFO [M:0;jenkins-hbase4:39369] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 18:01:23,319 INFO [M:0;jenkins-hbase4:39369] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39369 2023-02-17 18:01:23,323 DEBUG [M:0;jenkins-hbase4:39369] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39369,1676656868739 already deleted, retry=false 2023-02-17 18:01:23,424 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:23,424 INFO [M:0;jenkins-hbase4:39369] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39369,1676656868739; zookeeper connection closed. 2023-02-17 18:01:23,424 ERROR [Listener at localhost/36077-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c5bd800 rejected from java.util.concurrent.ThreadPoolExecutor@595c13b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:23,424 DEBUG [Listener at localhost/36077-EventThread] zookeeper.ZKWatcher(600): master:39369-0x100637163930000, quorum=127.0.0.1:54341, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:23,424 ERROR [Listener at localhost/36077-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@37bf3f40 rejected from java.util.concurrent.ThreadPoolExecutor@595c13b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:23,427 WARN [Listener at localhost/36077] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:23,431 INFO [Listener at localhost/36077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:23,535 WARN [BP-907501758-172.31.14.131-1676656865269 heartbeating to localhost/127.0.0.1:37141] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:23,535 WARN [BP-907501758-172.31.14.131-1676656865269 heartbeating to localhost/127.0.0.1:37141] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-907501758-172.31.14.131-1676656865269 (Datanode Uuid 5a5ae37c-0c91-41fc-a727-b76b3232c967) service to localhost/127.0.0.1:37141 2023-02-17 18:01:23,538 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/cluster_9efdca55-750a-e438-a008-db661fd2107e/dfs/data/data3/current/BP-907501758-172.31.14.131-1676656865269] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:23,538 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/cluster_9efdca55-750a-e438-a008-db661fd2107e/dfs/data/data4/current/BP-907501758-172.31.14.131-1676656865269] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:23,540 WARN [Listener at localhost/36077] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:23,544 INFO [Listener at localhost/36077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:23,548 WARN [BP-907501758-172.31.14.131-1676656865269 heartbeating to localhost/127.0.0.1:37141] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:23,548 WARN [BP-907501758-172.31.14.131-1676656865269 heartbeating to localhost/127.0.0.1:37141] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-907501758-172.31.14.131-1676656865269 (Datanode Uuid 1906d1db-c234-4cd6-9d29-b595b9160654) service to localhost/127.0.0.1:37141 2023-02-17 18:01:23,550 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/cluster_9efdca55-750a-e438-a008-db661fd2107e/dfs/data/data1/current/BP-907501758-172.31.14.131-1676656865269] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:23,550 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/cluster_9efdca55-750a-e438-a008-db661fd2107e/dfs/data/data2/current/BP-907501758-172.31.14.131-1676656865269] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:23,588 INFO [Listener at localhost/36077] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:23,715 INFO [Listener at localhost/36077] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 18:01:23,785 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 18:01:23,801 INFO [Listener at localhost/36077] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:37141 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:37141 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39369,1676656868739)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:37141 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@22fd5985 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:37141 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37141 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:37141 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:37141 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36077 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=535 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=361 (was 225) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=7866 (was 9355) 2023-02-17 18:01:23,811 INFO [Listener at localhost/36077] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=535, MaxFileDescriptor=60000, SystemLoadAverage=361, ProcessCount=171, AvailableMemoryMB=7861 2023-02-17 18:01:23,824 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/hadoop.log.dir so I do NOT create it in target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097 2023-02-17 18:01:23,825 WARN [Listener at localhost/36077] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 18:01:23,825 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/hadoop.tmp.dir so I do NOT create it in target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097 2023-02-17 18:01:23,825 WARN [Listener at localhost/36077] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c00136f3-73f1-5444-6425-3f6b44fa2260/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 18:01:23,825 DEBUG [Listener at localhost/36077] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097 2023-02-17 18:01:23,825 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 18:01:23,825 INFO [Listener at localhost/36077] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/cluster_62669028-177d-b01f-f5dc-19c98b18f939, deleteOnExit=true 2023-02-17 18:01:23,825 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 18:01:23,825 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/test.cache.data in system properties and HBase conf 2023-02-17 18:01:23,825 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 18:01:23,826 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/hadoop.log.dir in system properties and HBase conf 2023-02-17 18:01:23,826 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 18:01:23,826 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 18:01:23,826 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 18:01:23,826 DEBUG [Listener at localhost/36077] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 18:01:23,826 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:23,827 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:23,827 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 18:01:23,827 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:23,827 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 18:01:23,827 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 18:01:23,827 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:23,828 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:23,828 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 18:01:23,828 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/nfs.dump.dir in system properties and HBase conf 2023-02-17 18:01:23,828 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/java.io.tmpdir in system properties and HBase conf 2023-02-17 18:01:23,828 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:23,829 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 18:01:23,829 INFO [Listener at localhost/36077] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 18:01:23,833 WARN [Listener at localhost/36077] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:23,834 WARN [Listener at localhost/36077] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:23,873 WARN [Listener at localhost/36077] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:23,875 INFO [Listener at localhost/36077] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:23,879 INFO [Listener at localhost/36077] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/java.io.tmpdir/Jetty_localhost_34307_hdfs____.rcyuot/webapp 2023-02-17 18:01:23,977 INFO [Listener at localhost/36077] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34307 2023-02-17 18:01:23,982 WARN [Listener at localhost/36077] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:23,982 WARN [Listener at localhost/36077] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:24,027 WARN [Listener at localhost/44339] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:24,044 WARN [Listener at localhost/44339] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:24,046 WARN [Listener at localhost/44339] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:24,047 INFO [Listener at localhost/44339] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:24,052 INFO [Listener at localhost/44339] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/java.io.tmpdir/Jetty_localhost_43089_datanode____jb8p4p/webapp 2023-02-17 18:01:24,154 INFO [Listener at localhost/44339] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43089 2023-02-17 18:01:24,164 WARN [Listener at localhost/33263] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:24,198 WARN [Listener at localhost/33263] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:24,200 WARN [Listener at localhost/33263] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:24,201 INFO [Listener at localhost/33263] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:24,207 INFO [Listener at localhost/33263] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/java.io.tmpdir/Jetty_localhost_35745_datanode____.5o42pv/webapp 2023-02-17 18:01:24,304 INFO [Listener at localhost/33263] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35745 2023-02-17 18:01:24,313 WARN [Listener at localhost/46577] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:25,307 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69fa586ad5867c3c: Processing first storage report for DS-606b4e08-9291-4f86-8e9c-963345150cf7 from datanode f555f647-d688-47b6-9b35-00e6b94c555b 2023-02-17 18:01:25,308 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69fa586ad5867c3c: from storage DS-606b4e08-9291-4f86-8e9c-963345150cf7 node DatanodeRegistration(127.0.0.1:37871, datanodeUuid=f555f647-d688-47b6-9b35-00e6b94c555b, infoPort=43211, infoSecurePort=0, ipcPort=33263, storageInfo=lv=-57;cid=testClusterID;nsid=1261123416;c=1676656883836), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:25,308 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69fa586ad5867c3c: Processing first storage report for DS-bd6eeb77-da75-4056-acf0-8fce07efa5a4 from datanode f555f647-d688-47b6-9b35-00e6b94c555b 2023-02-17 18:01:25,308 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69fa586ad5867c3c: from storage DS-bd6eeb77-da75-4056-acf0-8fce07efa5a4 node DatanodeRegistration(127.0.0.1:37871, datanodeUuid=f555f647-d688-47b6-9b35-00e6b94c555b, infoPort=43211, infoSecurePort=0, ipcPort=33263, storageInfo=lv=-57;cid=testClusterID;nsid=1261123416;c=1676656883836), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:26,717 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa1bcee72a52b5840: Processing first storage report for DS-df0ae70c-760b-445c-a09a-65f9220dad51 from datanode 73a6b2d4-aec2-4676-b551-3db8b321a67e 2023-02-17 18:01:26,717 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa1bcee72a52b5840: from storage DS-df0ae70c-760b-445c-a09a-65f9220dad51 node DatanodeRegistration(127.0.0.1:38843, datanodeUuid=73a6b2d4-aec2-4676-b551-3db8b321a67e, infoPort=42999, infoSecurePort=0, ipcPort=46577, storageInfo=lv=-57;cid=testClusterID;nsid=1261123416;c=1676656883836), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:26,717 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa1bcee72a52b5840: Processing first storage report for DS-c204ea2b-c1df-4d20-81b8-3070b944ae02 from datanode 73a6b2d4-aec2-4676-b551-3db8b321a67e 2023-02-17 18:01:26,717 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa1bcee72a52b5840: from storage DS-c204ea2b-c1df-4d20-81b8-3070b944ae02 node DatanodeRegistration(127.0.0.1:38843, datanodeUuid=73a6b2d4-aec2-4676-b551-3db8b321a67e, infoPort=42999, infoSecurePort=0, ipcPort=46577, storageInfo=lv=-57;cid=testClusterID;nsid=1261123416;c=1676656883836), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:26,741 DEBUG [Listener at localhost/46577] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097 2023-02-17 18:01:26,751 INFO [Listener at localhost/46577] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/cluster_62669028-177d-b01f-f5dc-19c98b18f939/zookeeper_0, clientPort=53935, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/cluster_62669028-177d-b01f-f5dc-19c98b18f939/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/cluster_62669028-177d-b01f-f5dc-19c98b18f939/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 18:01:26,752 INFO [Listener at localhost/46577] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53935 2023-02-17 18:01:26,752 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:26,753 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:26,766 INFO [Listener at localhost/46577] util.FSUtils(479): Created version file at hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af with version=8 2023-02-17 18:01:26,767 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:26,768 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:26,769 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/hbase-staging 2023-02-17 18:01:26,771 INFO [Listener at localhost/46577] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:26,771 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:26,772 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:26,772 INFO [Listener at localhost/46577] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:26,772 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:26,772 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:26,772 INFO [Listener at localhost/46577] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:26,773 INFO [Listener at localhost/46577] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41793 2023-02-17 18:01:26,774 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:26,775 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:26,776 INFO [Listener at localhost/46577] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41793 connecting to ZooKeeper ensemble=127.0.0.1:53935 2023-02-17 18:01:27,012 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:417930x0, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:27,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41793-0x1006371ada30000 connected 2023-02-17 18:01:27,389 DEBUG [Listener at localhost/46577] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:27,390 DEBUG [Listener at localhost/46577] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:27,390 DEBUG [Listener at localhost/46577] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:27,391 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41793 2023-02-17 18:01:27,391 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41793 2023-02-17 18:01:27,392 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41793 2023-02-17 18:01:27,392 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41793 2023-02-17 18:01:27,393 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41793 2023-02-17 18:01:27,393 INFO [Listener at localhost/46577] master.HMaster(444): hbase.rootdir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af, hbase.cluster.distributed=false 2023-02-17 18:01:27,407 INFO [Listener at localhost/46577] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:27,407 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:27,407 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:27,408 INFO [Listener at localhost/46577] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:27,408 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:27,408 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:27,408 INFO [Listener at localhost/46577] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:27,410 INFO [Listener at localhost/46577] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45097 2023-02-17 18:01:27,411 INFO [Listener at localhost/46577] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:27,412 DEBUG [Listener at localhost/46577] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:27,412 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:27,413 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:27,414 INFO [Listener at localhost/46577] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45097 connecting to ZooKeeper ensemble=127.0.0.1:53935 2023-02-17 18:01:27,458 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:450970x0, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:27,459 DEBUG [Listener at localhost/46577] zookeeper.ZKUtil(164): regionserver:450970x0, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:27,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45097-0x1006371ada30001 connected 2023-02-17 18:01:27,460 DEBUG [Listener at localhost/46577] zookeeper.ZKUtil(164): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:27,460 DEBUG [Listener at localhost/46577] zookeeper.ZKUtil(164): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:27,461 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45097 2023-02-17 18:01:27,461 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45097 2023-02-17 18:01:27,461 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45097 2023-02-17 18:01:27,462 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45097 2023-02-17 18:01:27,462 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45097 2023-02-17 18:01:27,473 INFO [Listener at localhost/46577] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:27,473 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:27,473 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:27,473 INFO [Listener at localhost/46577] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:27,473 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:27,474 INFO [Listener at localhost/46577] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:27,474 INFO [Listener at localhost/46577] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:27,475 INFO [Listener at localhost/46577] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33675 2023-02-17 18:01:27,475 INFO [Listener at localhost/46577] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:27,476 DEBUG [Listener at localhost/46577] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:27,476 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:27,477 INFO [Listener at localhost/46577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:27,478 INFO [Listener at localhost/46577] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33675 connecting to ZooKeeper ensemble=127.0.0.1:53935 2023-02-17 18:01:27,543 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:336750x0, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:27,544 DEBUG [Listener at localhost/46577] zookeeper.ZKUtil(164): regionserver:336750x0, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:27,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33675-0x1006371ada30002 connected 2023-02-17 18:01:27,545 DEBUG [Listener at localhost/46577] zookeeper.ZKUtil(164): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:27,546 DEBUG [Listener at localhost/46577] zookeeper.ZKUtil(164): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:27,546 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33675 2023-02-17 18:01:27,546 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33675 2023-02-17 18:01:27,546 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33675 2023-02-17 18:01:27,547 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33675 2023-02-17 18:01:27,547 DEBUG [Listener at localhost/46577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33675 2023-02-17 18:01:27,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:27,558 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:27,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:27,595 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 18:01:27,604 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:27,604 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:27,604 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:27,604 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:27,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:27,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41793,1676656886771 from backup master directory 2023-02-17 18:01:27,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:27,658 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:27,658 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:27,658 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:27,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:27,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/hbase.id with ID: 7f302ecf-bd2b-4880-abe2-1b00ebad6320 2023-02-17 18:01:27,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:27,736 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:27,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3617732d to 127.0.0.1:53935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:27,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6033ed50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:27,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:27,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 18:01:27,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:27,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/data/master/store-tmp 2023-02-17 18:01:27,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:27,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:27,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:27,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:27,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:27,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:27,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:27,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:27,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/WALs/jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:27,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41793%2C1676656886771, suffix=, logDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/WALs/jenkins-hbase4.apache.org,41793,1676656886771, archiveDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/oldWALs, maxLogs=10 2023-02-17 18:01:27,810 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37871,DS-606b4e08-9291-4f86-8e9c-963345150cf7,DISK] 2023-02-17 18:01:27,810 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38843,DS-df0ae70c-760b-445c-a09a-65f9220dad51,DISK] 2023-02-17 18:01:27,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/WALs/jenkins-hbase4.apache.org,41793,1676656886771/jenkins-hbase4.apache.org%2C41793%2C1676656886771.1676656887793 2023-02-17 18:01:27,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37871,DS-606b4e08-9291-4f86-8e9c-963345150cf7,DISK], DatanodeInfoWithStorage[127.0.0.1:38843,DS-df0ae70c-760b-445c-a09a-65f9220dad51,DISK]] 2023-02-17 18:01:27,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:27,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:27,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:27,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:27,815 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:27,816 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 18:01:27,816 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 18:01:27,817 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:27,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:27,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:27,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:27,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:27,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72388852, jitterRate=0.0786779522895813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:27,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:27,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 18:01:27,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 18:01:27,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 18:01:27,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 18:01:27,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 18:01:27,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 18:01:27,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 18:01:27,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 18:01:27,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 18:01:27,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 18:01:27,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 18:01:27,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 18:01:27,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 18:01:27,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 18:01:27,889 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:27,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 18:01:27,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 18:01:27,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 18:01:27,942 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:27,942 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:27,943 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:27,942 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:27,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41793,1676656886771, sessionid=0x1006371ada30000, setting cluster-up flag (Was=false) 2023-02-17 18:01:28,012 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:28,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 18:01:28,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:28,251 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:28,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 18:01:28,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:28,345 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.hbase-snapshot/.tmp 2023-02-17 18:01:28,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:28,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:28,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:28,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:28,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:28,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 18:01:28,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:28,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,349 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(952): ClusterId : 7f302ecf-bd2b-4880-abe2-1b00ebad6320 2023-02-17 18:01:28,349 DEBUG [RS:0;jenkins-hbase4:45097] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:28,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676656918358 2023-02-17 18:01:28,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 18:01:28,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 18:01:28,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 18:01:28,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 18:01:28,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 18:01:28,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 18:01:28,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,359 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:28,359 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 18:01:28,360 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:28,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 18:01:28,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 18:01:28,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 18:01:28,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 18:01:28,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 18:01:28,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656888371,5,FailOnTimeoutGroup] 2023-02-17 18:01:28,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656888371,5,FailOnTimeoutGroup] 2023-02-17 18:01:28,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 18:01:28,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,372 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,374 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(952): ClusterId : 7f302ecf-bd2b-4880-abe2-1b00ebad6320 2023-02-17 18:01:28,374 DEBUG [RS:1;jenkins-hbase4:33675] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:28,374 DEBUG [RS:0;jenkins-hbase4:45097] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:28,374 DEBUG [RS:0;jenkins-hbase4:45097] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:28,379 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:28,380 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:28,380 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af 2023-02-17 18:01:28,388 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:28,393 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:28,394 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/info 2023-02-17 18:01:28,395 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:28,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:28,396 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:28,397 DEBUG [RS:1;jenkins-hbase4:33675] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:28,397 DEBUG [RS:1;jenkins-hbase4:33675] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:28,397 DEBUG [RS:0;jenkins-hbase4:45097] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:28,397 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:28,398 DEBUG [RS:0;jenkins-hbase4:45097] zookeeper.ReadOnlyZKClient(139): Connect 0x21746dc4 to 127.0.0.1:53935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:28,399 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:28,399 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:28,399 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:28,402 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/table 2023-02-17 18:01:28,403 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:28,403 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:28,404 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740 2023-02-17 18:01:28,405 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740 2023-02-17 18:01:28,407 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:28,409 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:28,411 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:28,411 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70970364, jitterRate=0.057540833950042725}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:28,411 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:28,412 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:28,412 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:28,412 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:28,412 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:28,412 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:28,412 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:28,412 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:28,414 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:28,414 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 18:01:28,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 18:01:28,416 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 18:01:28,416 DEBUG [RS:1;jenkins-hbase4:33675] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:28,418 DEBUG [RS:1;jenkins-hbase4:33675] zookeeper.ReadOnlyZKClient(139): Connect 0x1a6aa4a3 to 127.0.0.1:53935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:28,418 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 18:01:28,419 DEBUG [RS:0;jenkins-hbase4:45097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fb3979a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:28,419 DEBUG [RS:0;jenkins-hbase4:45097] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b8c06b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:28,423 DEBUG [RS:1;jenkins-hbase4:33675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14ad599e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:28,423 DEBUG [RS:1;jenkins-hbase4:33675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1092cfd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:28,432 DEBUG [RS:0;jenkins-hbase4:45097] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45097 2023-02-17 18:01:28,432 INFO [RS:0;jenkins-hbase4:45097] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:28,432 INFO [RS:0;jenkins-hbase4:45097] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:28,432 DEBUG [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:28,433 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41793,1676656886771 with isa=jenkins-hbase4.apache.org/172.31.14.131:45097, startcode=1676656887407 2023-02-17 18:01:28,433 DEBUG [RS:0;jenkins-hbase4:45097] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:28,434 DEBUG [RS:1;jenkins-hbase4:33675] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33675 2023-02-17 18:01:28,434 INFO [RS:1;jenkins-hbase4:33675] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:28,434 INFO [RS:1;jenkins-hbase4:33675] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:28,434 DEBUG [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:28,437 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49607, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:28,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:28,439 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41793,1676656886771 with isa=jenkins-hbase4.apache.org/172.31.14.131:33675, startcode=1676656887473 2023-02-17 18:01:28,439 DEBUG [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af 2023-02-17 18:01:28,439 DEBUG [RS:1;jenkins-hbase4:33675] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:28,439 DEBUG [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44339 2023-02-17 18:01:28,439 DEBUG [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:28,442 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38927, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:28,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:28,443 DEBUG [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af 2023-02-17 18:01:28,443 DEBUG [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44339 2023-02-17 18:01:28,443 DEBUG [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:28,443 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:28,452 DEBUG [RS:0;jenkins-hbase4:45097] zookeeper.ZKUtil(162): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:28,453 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33675,1676656887473] 2023-02-17 18:01:28,453 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45097,1676656887407] 2023-02-17 18:01:28,453 WARN [RS:0;jenkins-hbase4:45097] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:28,453 INFO [RS:0;jenkins-hbase4:45097] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:28,453 DEBUG [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/WALs/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:28,454 DEBUG [RS:1;jenkins-hbase4:33675] zookeeper.ZKUtil(162): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:28,454 WARN [RS:1;jenkins-hbase4:33675] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:28,454 INFO [RS:1;jenkins-hbase4:33675] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:28,455 DEBUG [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/WALs/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:28,459 DEBUG [RS:0;jenkins-hbase4:45097] zookeeper.ZKUtil(162): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:28,459 DEBUG [RS:0;jenkins-hbase4:45097] zookeeper.ZKUtil(162): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:28,460 DEBUG [RS:0;jenkins-hbase4:45097] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:28,461 INFO [RS:0;jenkins-hbase4:45097] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:28,465 INFO [RS:0;jenkins-hbase4:45097] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:28,465 INFO [RS:0;jenkins-hbase4:45097] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:28,465 INFO [RS:0;jenkins-hbase4:45097] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,466 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:28,467 INFO [RS:0;jenkins-hbase4:45097] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,467 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,468 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,468 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,468 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,468 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,469 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:28,469 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,469 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,469 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,469 DEBUG [RS:0;jenkins-hbase4:45097] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,475 INFO [RS:0;jenkins-hbase4:45097] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,475 INFO [RS:0;jenkins-hbase4:45097] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,475 INFO [RS:0;jenkins-hbase4:45097] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,475 DEBUG [RS:1;jenkins-hbase4:33675] zookeeper.ZKUtil(162): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:28,476 DEBUG [RS:1;jenkins-hbase4:33675] zookeeper.ZKUtil(162): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:28,477 DEBUG [RS:1;jenkins-hbase4:33675] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:28,478 INFO [RS:1;jenkins-hbase4:33675] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:28,530 INFO [RS:1;jenkins-hbase4:33675] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:28,530 INFO [RS:1;jenkins-hbase4:33675] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:28,530 INFO [RS:1;jenkins-hbase4:33675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,531 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:28,536 INFO [RS:1;jenkins-hbase4:33675] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,537 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,537 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,537 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,538 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,538 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,538 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:28,538 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,538 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,538 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,538 DEBUG [RS:1;jenkins-hbase4:33675] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:28,539 INFO [RS:1;jenkins-hbase4:33675] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,539 INFO [RS:1;jenkins-hbase4:33675] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,539 INFO [RS:1;jenkins-hbase4:33675] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,540 INFO [RS:0;jenkins-hbase4:45097] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:28,540 INFO [RS:0;jenkins-hbase4:45097] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45097,1676656887407-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,551 INFO [RS:0;jenkins-hbase4:45097] regionserver.Replication(203): jenkins-hbase4.apache.org,45097,1676656887407 started 2023-02-17 18:01:28,551 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45097,1676656887407, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45097, sessionid=0x1006371ada30001 2023-02-17 18:01:28,551 DEBUG [RS:0;jenkins-hbase4:45097] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:28,551 DEBUG [RS:0;jenkins-hbase4:45097] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:28,551 DEBUG [RS:0;jenkins-hbase4:45097] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45097,1676656887407' 2023-02-17 18:01:28,551 DEBUG [RS:0;jenkins-hbase4:45097] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:28,551 DEBUG [RS:0;jenkins-hbase4:45097] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:28,552 DEBUG [RS:0;jenkins-hbase4:45097] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:28,552 DEBUG [RS:0;jenkins-hbase4:45097] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:28,552 DEBUG [RS:0;jenkins-hbase4:45097] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:28,552 DEBUG [RS:0;jenkins-hbase4:45097] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45097,1676656887407' 2023-02-17 18:01:28,552 DEBUG [RS:0;jenkins-hbase4:45097] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:28,552 DEBUG [RS:0;jenkins-hbase4:45097] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:28,553 DEBUG [RS:0;jenkins-hbase4:45097] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:28,553 INFO [RS:0;jenkins-hbase4:45097] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:28,553 INFO [RS:0;jenkins-hbase4:45097] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:28,554 INFO [RS:1;jenkins-hbase4:33675] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:28,554 INFO [RS:1;jenkins-hbase4:33675] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33675,1676656887473-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,568 INFO [RS:1;jenkins-hbase4:33675] regionserver.Replication(203): jenkins-hbase4.apache.org,33675,1676656887473 started 2023-02-17 18:01:28,568 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33675,1676656887473, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33675, sessionid=0x1006371ada30002 2023-02-17 18:01:28,568 DEBUG [RS:1;jenkins-hbase4:33675] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:28,568 DEBUG [RS:1;jenkins-hbase4:33675] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:28,568 DEBUG [RS:1;jenkins-hbase4:33675] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33675,1676656887473' 2023-02-17 18:01:28,568 DEBUG [RS:1;jenkins-hbase4:33675] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:28,568 DEBUG [RS:1;jenkins-hbase4:33675] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:28,569 DEBUG [RS:1;jenkins-hbase4:33675] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:28,569 DEBUG [RS:1;jenkins-hbase4:33675] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:28,569 DEBUG [RS:1;jenkins-hbase4:33675] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:28,569 DEBUG [RS:1;jenkins-hbase4:33675] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33675,1676656887473' 2023-02-17 18:01:28,569 DEBUG [jenkins-hbase4:41793] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 18:01:28,569 DEBUG [RS:1;jenkins-hbase4:33675] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:28,569 DEBUG [jenkins-hbase4:41793] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:28,569 DEBUG [RS:1;jenkins-hbase4:33675] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:28,570 DEBUG [RS:1;jenkins-hbase4:33675] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:28,570 INFO [RS:1;jenkins-hbase4:33675] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:28,570 INFO [RS:1;jenkins-hbase4:33675] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:28,571 DEBUG [jenkins-hbase4:41793] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:28,571 DEBUG [jenkins-hbase4:41793] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:28,571 DEBUG [jenkins-hbase4:41793] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:28,572 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45097,1676656887407, state=OPENING 2023-02-17 18:01:28,573 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 18:01:28,574 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:28,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45097,1676656887407}] 2023-02-17 18:01:28,575 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:28,729 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:28,730 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:28,733 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:28,737 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 18:01:28,737 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:28,739 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45097%2C1676656887407.meta, suffix=.meta, logDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/WALs/jenkins-hbase4.apache.org,45097,1676656887407, archiveDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/oldWALs, maxLogs=32 2023-02-17 18:01:28,756 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38843,DS-df0ae70c-760b-445c-a09a-65f9220dad51,DISK] 2023-02-17 18:01:28,756 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37871,DS-606b4e08-9291-4f86-8e9c-963345150cf7,DISK] 2023-02-17 18:01:28,758 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/WALs/jenkins-hbase4.apache.org,45097,1676656887407/jenkins-hbase4.apache.org%2C45097%2C1676656887407.meta.1676656888740.meta 2023-02-17 18:01:28,758 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37871,DS-606b4e08-9291-4f86-8e9c-963345150cf7,DISK], DatanodeInfoWithStorage[127.0.0.1:38843,DS-df0ae70c-760b-445c-a09a-65f9220dad51,DISK]] 2023-02-17 18:01:28,758 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:28,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 18:01:28,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 18:01:28,760 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 18:01:28,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 18:01:28,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:28,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 18:01:28,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 18:01:28,762 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:28,763 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/info 2023-02-17 18:01:28,763 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/info 2023-02-17 18:01:28,763 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:28,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:28,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:28,765 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:28,765 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:28,765 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:28,765 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:28,766 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:28,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/table 2023-02-17 18:01:28,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/table 2023-02-17 18:01:28,767 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:28,767 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:28,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740 2023-02-17 18:01:28,769 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740 2023-02-17 18:01:28,771 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:28,772 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:28,773 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63493741, jitterRate=-0.05386953055858612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:28,773 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:28,774 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676656888729 2023-02-17 18:01:28,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 18:01:28,780 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 18:01:28,781 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45097,1676656887407, state=OPEN 2023-02-17 18:01:28,783 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 18:01:28,783 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:28,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 18:01:28,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45097,1676656887407 in 208 msec 2023-02-17 18:01:28,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 18:01:28,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 375 msec 2023-02-17 18:01:28,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 450 msec 2023-02-17 18:01:28,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676656888797, completionTime=-1 2023-02-17 18:01:28,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 18:01:28,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 18:01:28,802 DEBUG [hconnection-0x68fec808-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:28,808 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59994, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:28,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 18:01:28,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676656948810 2023-02-17 18:01:28,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676657008810 2023-02-17 18:01:28,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 12 msec 2023-02-17 18:01:28,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676656886771-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676656886771-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676656886771-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41793, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:28,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 18:01:28,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:28,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 18:01:28,833 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:28,835 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:28,837 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 18:01:28,837 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:28,838 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b empty. 2023-02-17 18:01:28,838 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:28,839 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 18:01:28,860 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:28,864 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e0bd631e9793d46639c221ee502f833b, NAME => 'hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:28,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:28,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e0bd631e9793d46639c221ee502f833b, disabling compactions & flushes 2023-02-17 18:01:28,879 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:28,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:28,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. after waiting 0 ms 2023-02-17 18:01:28,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:28,879 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:28,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e0bd631e9793d46639c221ee502f833b: 2023-02-17 18:01:28,882 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:28,883 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656888883"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656888883"}]},"ts":"1676656888883"} 2023-02-17 18:01:28,886 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:28,887 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:28,888 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656888887"}]},"ts":"1676656888887"} 2023-02-17 18:01:28,889 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 18:01:28,892 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:28,893 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:28,893 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:28,893 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:28,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e0bd631e9793d46639c221ee502f833b, ASSIGN}] 2023-02-17 18:01:28,896 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e0bd631e9793d46639c221ee502f833b, ASSIGN 2023-02-17 18:01:28,897 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e0bd631e9793d46639c221ee502f833b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45097,1676656887407; forceNewPlan=false, retain=false 2023-02-17 18:01:29,047 INFO [jenkins-hbase4:41793] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:29,048 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e0bd631e9793d46639c221ee502f833b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:29,048 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656889048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889048"}]},"ts":"1676656889048"} 2023-02-17 18:01:29,051 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e0bd631e9793d46639c221ee502f833b, server=jenkins-hbase4.apache.org,45097,1676656887407}] 2023-02-17 18:01:29,207 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:29,209 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45097%2C1676656887407, suffix=, logDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/WALs/jenkins-hbase4.apache.org,45097,1676656887407, archiveDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/oldWALs, maxLogs=32 2023-02-17 18:01:29,225 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38843,DS-df0ae70c-760b-445c-a09a-65f9220dad51,DISK] 2023-02-17 18:01:29,226 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37871,DS-606b4e08-9291-4f86-8e9c-963345150cf7,DISK] 2023-02-17 18:01:29,228 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/WALs/jenkins-hbase4.apache.org,45097,1676656887407/jenkins-hbase4.apache.org%2C45097%2C1676656887407.1676656889210 2023-02-17 18:01:29,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38843,DS-df0ae70c-760b-445c-a09a-65f9220dad51,DISK], DatanodeInfoWithStorage[127.0.0.1:37871,DS-606b4e08-9291-4f86-8e9c-963345150cf7,DISK]] 2023-02-17 18:01:29,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e0bd631e9793d46639c221ee502f833b, NAME => 'hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:29,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:29,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:29,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:29,230 INFO [StoreOpener-e0bd631e9793d46639c221ee502f833b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:29,232 DEBUG [StoreOpener-e0bd631e9793d46639c221ee502f833b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b/info 2023-02-17 18:01:29,232 DEBUG [StoreOpener-e0bd631e9793d46639c221ee502f833b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b/info 2023-02-17 18:01:29,233 INFO [StoreOpener-e0bd631e9793d46639c221ee502f833b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0bd631e9793d46639c221ee502f833b columnFamilyName info 2023-02-17 18:01:29,233 INFO [StoreOpener-e0bd631e9793d46639c221ee502f833b-1] regionserver.HStore(310): Store=e0bd631e9793d46639c221ee502f833b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:29,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:29,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:29,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:29,239 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:29,239 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e0bd631e9793d46639c221ee502f833b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66572175, jitterRate=-0.007997289299964905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:29,239 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e0bd631e9793d46639c221ee502f833b: 2023-02-17 18:01:29,240 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b., pid=6, masterSystemTime=1676656889203 2023-02-17 18:01:29,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:29,243 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:29,243 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e0bd631e9793d46639c221ee502f833b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:29,243 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656889243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656889243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656889243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656889243"}]},"ts":"1676656889243"} 2023-02-17 18:01:29,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 18:01:29,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e0bd631e9793d46639c221ee502f833b, server=jenkins-hbase4.apache.org,45097,1676656887407 in 194 msec 2023-02-17 18:01:29,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 18:01:29,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e0bd631e9793d46639c221ee502f833b, ASSIGN in 354 msec 2023-02-17 18:01:29,250 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:29,250 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656889250"}]},"ts":"1676656889250"} 2023-02-17 18:01:29,252 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 18:01:29,255 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:29,257 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 428 msec 2023-02-17 18:01:29,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 18:01:29,332 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:29,332 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:29,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 18:01:29,349 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:29,352 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 14 msec 2023-02-17 18:01:29,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 18:01:29,372 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:29,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-02-17 18:01:29,386 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 18:01:29,392 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 18:01:29,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.734sec 2023-02-17 18:01:29,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 18:01:29,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 18:01:29,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 18:01:29,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676656886771-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 18:01:29,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41793,1676656886771-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 18:01:29,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 18:01:29,458 DEBUG [Listener at localhost/46577] zookeeper.ReadOnlyZKClient(139): Connect 0x2098ea7a to 127.0.0.1:53935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:29,468 DEBUG [Listener at localhost/46577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d4d38da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:29,470 DEBUG [hconnection-0x77ffd67b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:29,474 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:29,476 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:29,476 DEBUG [Listener at localhost/46577] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 18:01:29,479 DEBUG [Listener at localhost/46577] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 18:01:29,483 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 18:01:29,484 INFO [Listener at localhost/46577] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 18:01:29,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 18:01:29,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 18:01:29,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:53266 deadline: 1676656949484, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-17 18:01:29,485 INFO [Listener at localhost/46577] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-17 18:01:29,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:29,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-17 18:01:29,492 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:29,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-17 18:01:29,494 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:29,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:29,505 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:29,505 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:29,505 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:29,505 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:29,505 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:29,505 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:29,505 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:29,505 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:29,506 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f empty. 2023-02-17 18:01:29,506 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525 empty. 2023-02-17 18:01:29,506 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f empty. 2023-02-17 18:01:29,506 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b empty. 2023-02-17 18:01:29,506 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896 empty. 2023-02-17 18:01:29,506 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a empty. 2023-02-17 18:01:29,506 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf empty. 2023-02-17 18:01:29,506 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f empty. 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:29,507 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552 empty. 2023-02-17 18:01:29,508 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:29,508 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6 empty. 2023-02-17 18:01:29,508 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:29,508 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:29,508 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 18:01:29,524 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:29,526 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => cb2d88a813a8a16986e91c86c7019b6b, NAME => 'testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,526 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9aa47450c18159eb010cbd44a0b38896, NAME => 'testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,528 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 885fbc7cabc4d807b5ea46913a08630f, NAME => 'testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,540 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,540 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 9aa47450c18159eb010cbd44a0b38896, disabling compactions & flushes 2023-02-17 18:01:29,540 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:29,540 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:29,540 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. after waiting 0 ms 2023-02-17 18:01:29,540 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:29,540 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:29,540 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 9aa47450c18159eb010cbd44a0b38896: 2023-02-17 18:01:29,541 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 438412d7b22fbc75872a98e8c3225e9a, NAME => 'testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing cb2d88a813a8a16986e91c86c7019b6b, disabling compactions & flushes 2023-02-17 18:01:29,548 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:29,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:29,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. after waiting 0 ms 2023-02-17 18:01:29,548 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:29,548 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:29,549 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for cb2d88a813a8a16986e91c86c7019b6b: 2023-02-17 18:01:29,549 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a29b3043c1bf8fa8ceeba0cbadad77cf, NAME => 'testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,551 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,551 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 885fbc7cabc4d807b5ea46913a08630f, disabling compactions & flushes 2023-02-17 18:01:29,551 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:29,551 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:29,551 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. after waiting 0 ms 2023-02-17 18:01:29,551 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:29,551 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:29,551 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 885fbc7cabc4d807b5ea46913a08630f: 2023-02-17 18:01:29,552 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => f883c8755c55162e5bdc1460cc22b78f, NAME => 'testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,557 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,557 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 438412d7b22fbc75872a98e8c3225e9a, disabling compactions & flushes 2023-02-17 18:01:29,557 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:29,557 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:29,557 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. after waiting 0 ms 2023-02-17 18:01:29,557 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:29,557 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:29,557 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 438412d7b22fbc75872a98e8c3225e9a: 2023-02-17 18:01:29,558 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4296cab86e8af48c221caaf0e166a525, NAME => 'testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,564 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing f883c8755c55162e5bdc1460cc22b78f, disabling compactions & flushes 2023-02-17 18:01:29,565 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:29,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:29,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. after waiting 0 ms 2023-02-17 18:01:29,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:29,565 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:29,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for f883c8755c55162e5bdc1460cc22b78f: 2023-02-17 18:01:29,565 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ff371276b52a00a0329f31e5039e1f0f, NAME => 'testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,571 INFO [RS:1;jenkins-hbase4:33675] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33675%2C1676656887473, suffix=, logDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/WALs/jenkins-hbase4.apache.org,33675,1676656887473, archiveDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/oldWALs, maxLogs=32 2023-02-17 18:01:29,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a29b3043c1bf8fa8ceeba0cbadad77cf, disabling compactions & flushes 2023-02-17 18:01:29,572 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:29,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:29,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. after waiting 0 ms 2023-02-17 18:01:29,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:29,572 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:29,572 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a29b3043c1bf8fa8ceeba0cbadad77cf: 2023-02-17 18:01:29,573 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0edc1fa6cb68190eb80dfc8ab71e97c6, NAME => 'testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,596 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38843,DS-df0ae70c-760b-445c-a09a-65f9220dad51,DISK] 2023-02-17 18:01:29,596 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37871,DS-606b4e08-9291-4f86-8e9c-963345150cf7,DISK] 2023-02-17 18:01:29,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:29,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4296cab86e8af48c221caaf0e166a525, disabling compactions & flushes 2023-02-17 18:01:29,600 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:29,600 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:29,601 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. after waiting 0 ms 2023-02-17 18:01:29,601 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:29,601 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:29,601 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4296cab86e8af48c221caaf0e166a525: 2023-02-17 18:01:29,601 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => de34f4ac261ab451cc08d3d164d0d552, NAME => 'testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.tmp 2023-02-17 18:01:29,613 INFO [RS:1;jenkins-hbase4:33675] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/WALs/jenkins-hbase4.apache.org,33675,1676656887473/jenkins-hbase4.apache.org%2C33675%2C1676656887473.1676656889572 2023-02-17 18:01:29,620 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,620 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ff371276b52a00a0329f31e5039e1f0f, disabling compactions & flushes 2023-02-17 18:01:29,620 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:29,620 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:29,620 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. after waiting 0 ms 2023-02-17 18:01:29,621 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:29,621 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:29,621 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ff371276b52a00a0329f31e5039e1f0f: 2023-02-17 18:01:29,624 DEBUG [RS:1;jenkins-hbase4:33675] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38843,DS-df0ae70c-760b-445c-a09a-65f9220dad51,DISK], DatanodeInfoWithStorage[127.0.0.1:37871,DS-606b4e08-9291-4f86-8e9c-963345150cf7,DISK]] 2023-02-17 18:01:29,628 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,628 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0edc1fa6cb68190eb80dfc8ab71e97c6, disabling compactions & flushes 2023-02-17 18:01:29,628 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:29,628 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:29,628 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. after waiting 0 ms 2023-02-17 18:01:29,628 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:29,628 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:29,628 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0edc1fa6cb68190eb80dfc8ab71e97c6: 2023-02-17 18:01:29,632 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing de34f4ac261ab451cc08d3d164d0d552, disabling compactions & flushes 2023-02-17 18:01:29,633 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:29,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:29,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. after waiting 0 ms 2023-02-17 18:01:29,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:29,633 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:29,633 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for de34f4ac261ab451cc08d3d164d0d552: 2023-02-17 18:01:29,635 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:29,636 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,636 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656889636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656889636"}]},"ts":"1676656889636"} 2023-02-17 18:01:29,644 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-17 18:01:29,645 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:29,645 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656889645"}]},"ts":"1676656889645"} 2023-02-17 18:01:29,647 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-17 18:01:29,655 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:29,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:29,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:29,665 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:29,666 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb2d88a813a8a16986e91c86c7019b6b, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9aa47450c18159eb010cbd44a0b38896, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=885fbc7cabc4d807b5ea46913a08630f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=438412d7b22fbc75872a98e8c3225e9a, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a29b3043c1bf8fa8ceeba0cbadad77cf, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f883c8755c55162e5bdc1460cc22b78f, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4296cab86e8af48c221caaf0e166a525, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ff371276b52a00a0329f31e5039e1f0f, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0edc1fa6cb68190eb80dfc8ab71e97c6, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=de34f4ac261ab451cc08d3d164d0d552, ASSIGN}] 2023-02-17 18:01:29,669 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=de34f4ac261ab451cc08d3d164d0d552, ASSIGN 2023-02-17 18:01:29,670 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=de34f4ac261ab451cc08d3d164d0d552, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33675,1676656887473; forceNewPlan=false, retain=false 2023-02-17 18:01:29,671 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0edc1fa6cb68190eb80dfc8ab71e97c6, ASSIGN 2023-02-17 18:01:29,672 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0edc1fa6cb68190eb80dfc8ab71e97c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45097,1676656887407; forceNewPlan=false, retain=false 2023-02-17 18:01:29,673 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ff371276b52a00a0329f31e5039e1f0f, ASSIGN 2023-02-17 18:01:29,673 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ff371276b52a00a0329f31e5039e1f0f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33675,1676656887473; forceNewPlan=false, retain=false 2023-02-17 18:01:29,674 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9aa47450c18159eb010cbd44a0b38896, ASSIGN 2023-02-17 18:01:29,674 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f883c8755c55162e5bdc1460cc22b78f, ASSIGN 2023-02-17 18:01:29,674 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb2d88a813a8a16986e91c86c7019b6b, ASSIGN 2023-02-17 18:01:29,674 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4296cab86e8af48c221caaf0e166a525, ASSIGN 2023-02-17 18:01:29,675 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a29b3043c1bf8fa8ceeba0cbadad77cf, ASSIGN 2023-02-17 18:01:29,676 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9aa47450c18159eb010cbd44a0b38896, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45097,1676656887407; forceNewPlan=false, retain=false 2023-02-17 18:01:29,676 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f883c8755c55162e5bdc1460cc22b78f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45097,1676656887407; forceNewPlan=false, retain=false 2023-02-17 18:01:29,676 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cb2d88a813a8a16986e91c86c7019b6b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33675,1676656887473; forceNewPlan=false, retain=false 2023-02-17 18:01:29,677 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4296cab86e8af48c221caaf0e166a525, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45097,1676656887407; forceNewPlan=false, retain=false 2023-02-17 18:01:29,678 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=438412d7b22fbc75872a98e8c3225e9a, ASSIGN 2023-02-17 18:01:29,678 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=885fbc7cabc4d807b5ea46913a08630f, ASSIGN 2023-02-17 18:01:29,679 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=438412d7b22fbc75872a98e8c3225e9a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33675,1676656887473; forceNewPlan=false, retain=false 2023-02-17 18:01:29,679 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=885fbc7cabc4d807b5ea46913a08630f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45097,1676656887407; forceNewPlan=false, retain=false 2023-02-17 18:01:29,680 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a29b3043c1bf8fa8ceeba0cbadad77cf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33675,1676656887473; forceNewPlan=false, retain=false 2023-02-17 18:01:29,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:29,820 INFO [jenkins-hbase4:41793] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-17 18:01:29,824 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=4296cab86e8af48c221caaf0e166a525, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:29,824 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=9aa47450c18159eb010cbd44a0b38896, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:29,824 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889824"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889824"}]},"ts":"1676656889824"} 2023-02-17 18:01:29,824 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f883c8755c55162e5bdc1460cc22b78f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:29,824 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889824"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889824"}]},"ts":"1676656889824"} 2023-02-17 18:01:29,824 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=885fbc7cabc4d807b5ea46913a08630f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:29,824 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0edc1fa6cb68190eb80dfc8ab71e97c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:29,825 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889824"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889824"}]},"ts":"1676656889824"} 2023-02-17 18:01:29,825 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889824"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889824"}]},"ts":"1676656889824"} 2023-02-17 18:01:29,825 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889824"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889824"}]},"ts":"1676656889824"} 2023-02-17 18:01:29,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure 4296cab86e8af48c221caaf0e166a525, server=jenkins-hbase4.apache.org,45097,1676656887407}] 2023-02-17 18:01:29,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 9aa47450c18159eb010cbd44a0b38896, server=jenkins-hbase4.apache.org,45097,1676656887407}] 2023-02-17 18:01:29,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 885fbc7cabc4d807b5ea46913a08630f, server=jenkins-hbase4.apache.org,45097,1676656887407}] 2023-02-17 18:01:29,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure f883c8755c55162e5bdc1460cc22b78f, server=jenkins-hbase4.apache.org,45097,1676656887407}] 2023-02-17 18:01:29,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure 0edc1fa6cb68190eb80dfc8ab71e97c6, server=jenkins-hbase4.apache.org,45097,1676656887407}] 2023-02-17 18:01:29,833 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a29b3043c1bf8fa8ceeba0cbadad77cf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:29,833 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ff371276b52a00a0329f31e5039e1f0f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:29,833 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889832"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889832"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889832"}]},"ts":"1676656889832"} 2023-02-17 18:01:29,833 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889833"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889833"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889833"}]},"ts":"1676656889833"} 2023-02-17 18:01:29,834 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=de34f4ac261ab451cc08d3d164d0d552, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:29,834 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656889834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889834"}]},"ts":"1676656889834"} 2023-02-17 18:01:29,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure a29b3043c1bf8fa8ceeba0cbadad77cf, server=jenkins-hbase4.apache.org,33675,1676656887473}] 2023-02-17 18:01:29,837 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=438412d7b22fbc75872a98e8c3225e9a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:29,837 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656889837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889837"}]},"ts":"1676656889837"} 2023-02-17 18:01:29,837 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cb2d88a813a8a16986e91c86c7019b6b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:29,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure ff371276b52a00a0329f31e5039e1f0f, server=jenkins-hbase4.apache.org,33675,1676656887473}] 2023-02-17 18:01:29,837 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656889837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656889837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656889837"}]},"ts":"1676656889837"} 2023-02-17 18:01:29,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure de34f4ac261ab451cc08d3d164d0d552, server=jenkins-hbase4.apache.org,33675,1676656887473}] 2023-02-17 18:01:29,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure 438412d7b22fbc75872a98e8c3225e9a, server=jenkins-hbase4.apache.org,33675,1676656887473}] 2023-02-17 18:01:29,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure cb2d88a813a8a16986e91c86c7019b6b, server=jenkins-hbase4.apache.org,33675,1676656887473}] 2023-02-17 18:01:29,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:29,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9aa47450c18159eb010cbd44a0b38896, NAME => 'testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-17 18:01:29,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:29,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:29,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:29,985 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:29,987 DEBUG [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1 2023-02-17 18:01:29,987 DEBUG [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1 2023-02-17 18:01:29,987 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aa47450c18159eb010cbd44a0b38896 columnFamilyName f1 2023-02-17 18:01:29,988 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:29,988 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:29,989 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(310): Store=9aa47450c18159eb010cbd44a0b38896/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:29,989 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:29,992 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59316, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:29,992 DEBUG [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2 2023-02-17 18:01:29,992 DEBUG [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2 2023-02-17 18:01:29,993 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aa47450c18159eb010cbd44a0b38896 columnFamilyName f2 2023-02-17 18:01:29,994 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(310): Store=9aa47450c18159eb010cbd44a0b38896/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:29,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:29,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:29,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ff371276b52a00a0329f31e5039e1f0f, NAME => 'testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-17 18:01:29,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:29,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:29,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:29,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:29,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:29,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:29,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:30,000 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:30,001 DEBUG [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1 2023-02-17 18:01:30,001 DEBUG [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1 2023-02-17 18:01:30,002 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff371276b52a00a0329f31e5039e1f0f columnFamilyName f1 2023-02-17 18:01:30,002 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(310): Store=ff371276b52a00a0329f31e5039e1f0f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,002 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:30,004 DEBUG [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2 2023-02-17 18:01:30,004 DEBUG [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2 2023-02-17 18:01:30,004 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff371276b52a00a0329f31e5039e1f0f columnFamilyName f2 2023-02-17 18:01:30,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,005 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(310): Store=ff371276b52a00a0329f31e5039e1f0f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9aa47450c18159eb010cbd44a0b38896; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60069752, jitterRate=-0.10489094257354736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9aa47450c18159eb010cbd44a0b38896: 2023-02-17 18:01:30,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:30,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896., pid=22, masterSystemTime=1676656889979 2023-02-17 18:01:30,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:30,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:30,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:30,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:30,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:30,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f883c8755c55162e5bdc1460cc22b78f, NAME => 'testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-17 18:01:30,009 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=9aa47450c18159eb010cbd44a0b38896, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,009 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656890009"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890009"}]},"ts":"1676656890009"} 2023-02-17 18:01:30,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:30,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:30,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:30,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:30,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:30,012 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:30,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,014 DEBUG [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1 2023-02-17 18:01:30,015 DEBUG [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1 2023-02-17 18:01:30,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ff371276b52a00a0329f31e5039e1f0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74045324, jitterRate=0.10336130857467651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,015 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f883c8755c55162e5bdc1460cc22b78f columnFamilyName f1 2023-02-17 18:01:30,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-17 18:01:30,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ff371276b52a00a0329f31e5039e1f0f: 2023-02-17 18:01:30,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 9aa47450c18159eb010cbd44a0b38896, server=jenkins-hbase4.apache.org,45097,1676656887407 in 185 msec 2023-02-17 18:01:30,016 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(310): Store=f883c8755c55162e5bdc1460cc22b78f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,016 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:30,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f., pid=27, masterSystemTime=1676656889988 2023-02-17 18:01:30,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9aa47450c18159eb010cbd44a0b38896, ASSIGN in 349 msec 2023-02-17 18:01:30,022 DEBUG [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2 2023-02-17 18:01:30,022 DEBUG [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2 2023-02-17 18:01:30,023 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f883c8755c55162e5bdc1460cc22b78f columnFamilyName f2 2023-02-17 18:01:30,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:30,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:30,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:30,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => de34f4ac261ab451cc08d3d164d0d552, NAME => 'testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-17 18:01:30,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:30,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:30,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:30,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:30,025 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(310): Store=f883c8755c55162e5bdc1460cc22b78f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,025 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ff371276b52a00a0329f31e5039e1f0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,026 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656890025"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890025"}]},"ts":"1676656890025"} 2023-02-17 18:01:30,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:30,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:30,026 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:30,029 DEBUG [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552/f1 2023-02-17 18:01:30,029 DEBUG [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552/f1 2023-02-17 18:01:30,029 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de34f4ac261ab451cc08d3d164d0d552 columnFamilyName f1 2023-02-17 18:01:30,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:30,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-17 18:01:30,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure ff371276b52a00a0329f31e5039e1f0f, server=jenkins-hbase4.apache.org,33675,1676656887473 in 190 msec 2023-02-17 18:01:30,030 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] regionserver.HStore(310): Store=de34f4ac261ab451cc08d3d164d0d552/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,030 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:30,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ff371276b52a00a0329f31e5039e1f0f, ASSIGN in 363 msec 2023-02-17 18:01:30,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:30,032 DEBUG [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552/f2 2023-02-17 18:01:30,032 DEBUG [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552/f2 2023-02-17 18:01:30,032 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de34f4ac261ab451cc08d3d164d0d552 columnFamilyName f2 2023-02-17 18:01:30,036 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] regionserver.HStore(310): Store=de34f4ac261ab451cc08d3d164d0d552/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:30,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f883c8755c55162e5bdc1460cc22b78f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74192183, jitterRate=0.10554967820644379}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f883c8755c55162e5bdc1460cc22b78f: 2023-02-17 18:01:30,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:30,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f., pid=24, masterSystemTime=1676656889979 2023-02-17 18:01:30,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:30,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:30,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:30,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:30,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4296cab86e8af48c221caaf0e166a525, NAME => 'testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-17 18:01:30,057 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f883c8755c55162e5bdc1460cc22b78f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:30,057 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656890057"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890057"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890057"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890057"}]},"ts":"1676656890057"} 2023-02-17 18:01:30,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:30,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:30,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:30,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:30,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-17 18:01:30,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure f883c8755c55162e5bdc1460cc22b78f, server=jenkins-hbase4.apache.org,45097,1676656887407 in 230 msec 2023-02-17 18:01:30,063 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f883c8755c55162e5bdc1460cc22b78f, ASSIGN in 396 msec 2023-02-17 18:01:30,067 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:30,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,072 DEBUG [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1 2023-02-17 18:01:30,072 DEBUG [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1 2023-02-17 18:01:30,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened de34f4ac261ab451cc08d3d164d0d552; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70384747, jitterRate=0.04881446063518524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for de34f4ac261ab451cc08d3d164d0d552: 2023-02-17 18:01:30,073 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4296cab86e8af48c221caaf0e166a525 columnFamilyName f1 2023-02-17 18:01:30,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552., pid=28, masterSystemTime=1676656889988 2023-02-17 18:01:30,073 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(310): Store=4296cab86e8af48c221caaf0e166a525/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,073 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:30,075 DEBUG [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2 2023-02-17 18:01:30,075 DEBUG [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2 2023-02-17 18:01:30,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:30,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:30,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:30,075 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4296cab86e8af48c221caaf0e166a525 columnFamilyName f2 2023-02-17 18:01:30,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 438412d7b22fbc75872a98e8c3225e9a, NAME => 'testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-17 18:01:30,075 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=de34f4ac261ab451cc08d3d164d0d552, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:30,076 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656890075"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890075"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890075"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890075"}]},"ts":"1676656890075"} 2023-02-17 18:01:30,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:30,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:30,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:30,076 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(310): Store=4296cab86e8af48c221caaf0e166a525/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:30,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:30,079 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:30,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-17 18:01:30,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure de34f4ac261ab451cc08d3d164d0d552, server=jenkins-hbase4.apache.org,33675,1676656887473 in 239 msec 2023-02-17 18:01:30,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:30,080 DEBUG [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1 2023-02-17 18:01:30,080 DEBUG [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1 2023-02-17 18:01:30,081 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 438412d7b22fbc75872a98e8c3225e9a columnFamilyName f1 2023-02-17 18:01:30,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=de34f4ac261ab451cc08d3d164d0d552, ASSIGN in 414 msec 2023-02-17 18:01:30,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:30,081 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(310): Store=438412d7b22fbc75872a98e8c3225e9a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,082 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:30,083 DEBUG [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2 2023-02-17 18:01:30,083 DEBUG [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2 2023-02-17 18:01:30,083 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 438412d7b22fbc75872a98e8c3225e9a columnFamilyName f2 2023-02-17 18:01:30,088 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(310): Store=438412d7b22fbc75872a98e8c3225e9a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4296cab86e8af48c221caaf0e166a525; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60426583, jitterRate=-0.09957374632358551}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4296cab86e8af48c221caaf0e166a525: 2023-02-17 18:01:30,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:30,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:30,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525., pid=21, masterSystemTime=1676656889979 2023-02-17 18:01:30,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:30,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:30,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:30,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0edc1fa6cb68190eb80dfc8ab71e97c6, NAME => 'testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-17 18:01:30,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:30,092 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=4296cab86e8af48c221caaf0e166a525, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:30,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:30,092 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656890091"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890091"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890091"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890091"}]},"ts":"1676656890091"} 2023-02-17 18:01:30,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:30,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:30,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:30,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-17 18:01:30,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure 4296cab86e8af48c221caaf0e166a525, server=jenkins-hbase4.apache.org,45097,1676656887407 in 268 msec 2023-02-17 18:01:30,097 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4296cab86e8af48c221caaf0e166a525, ASSIGN in 430 msec 2023-02-17 18:01:30,102 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:30,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:30,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 438412d7b22fbc75872a98e8c3225e9a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61573169, jitterRate=-0.0824882835149765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 438412d7b22fbc75872a98e8c3225e9a: 2023-02-17 18:01:30,103 DEBUG [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1 2023-02-17 18:01:30,103 DEBUG [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1 2023-02-17 18:01:30,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a., pid=29, masterSystemTime=1676656889988 2023-02-17 18:01:30,104 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0edc1fa6cb68190eb80dfc8ab71e97c6 columnFamilyName f1 2023-02-17 18:01:30,105 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(310): Store=0edc1fa6cb68190eb80dfc8ab71e97c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,105 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:30,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:30,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:30,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:30,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a29b3043c1bf8fa8ceeba0cbadad77cf, NAME => 'testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-17 18:01:30,105 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=438412d7b22fbc75872a98e8c3225e9a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:30,106 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656890105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890105"}]},"ts":"1676656890105"} 2023-02-17 18:01:30,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:30,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:30,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:30,107 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:30,108 DEBUG [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2 2023-02-17 18:01:30,108 DEBUG [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1 2023-02-17 18:01:30,108 DEBUG [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2 2023-02-17 18:01:30,109 DEBUG [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1 2023-02-17 18:01:30,109 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a29b3043c1bf8fa8ceeba0cbadad77cf columnFamilyName f1 2023-02-17 18:01:30,109 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0edc1fa6cb68190eb80dfc8ab71e97c6 columnFamilyName f2 2023-02-17 18:01:30,110 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(310): Store=a29b3043c1bf8fa8ceeba0cbadad77cf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,110 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(310): Store=0edc1fa6cb68190eb80dfc8ab71e97c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,110 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:30,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-17 18:01:30,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure 438412d7b22fbc75872a98e8c3225e9a, server=jenkins-hbase4.apache.org,33675,1676656887473 in 269 msec 2023-02-17 18:01:30,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:30,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:30,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=438412d7b22fbc75872a98e8c3225e9a, ASSIGN in 444 msec 2023-02-17 18:01:30,113 DEBUG [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2 2023-02-17 18:01:30,113 DEBUG [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2 2023-02-17 18:01:30,113 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a29b3043c1bf8fa8ceeba0cbadad77cf columnFamilyName f2 2023-02-17 18:01:30,114 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(310): Store=a29b3043c1bf8fa8ceeba0cbadad77cf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:30,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:30,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:30,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:30,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:30,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:30,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0edc1fa6cb68190eb80dfc8ab71e97c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72176776, jitterRate=0.07551777362823486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0edc1fa6cb68190eb80dfc8ab71e97c6: 2023-02-17 18:01:30,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6., pid=25, masterSystemTime=1676656889979 2023-02-17 18:01:30,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a29b3043c1bf8fa8ceeba0cbadad77cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73734913, jitterRate=0.09873582422733307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a29b3043c1bf8fa8ceeba0cbadad77cf: 2023-02-17 18:01:30,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:30,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:30,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:30,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf., pid=26, masterSystemTime=1676656889988 2023-02-17 18:01:30,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 885fbc7cabc4d807b5ea46913a08630f, NAME => 'testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-17 18:01:30,122 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0edc1fa6cb68190eb80dfc8ab71e97c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:30,122 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656890122"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890122"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890122"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890122"}]},"ts":"1676656890122"} 2023-02-17 18:01:30,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:30,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:30,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:30,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:30,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:30,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:30,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb2d88a813a8a16986e91c86c7019b6b, NAME => 'testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-17 18:01:30,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:30,124 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:30,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:30,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:30,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:30,124 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=a29b3043c1bf8fa8ceeba0cbadad77cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,124 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656890124"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890124"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890124"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890124"}]},"ts":"1676656890124"} 2023-02-17 18:01:30,126 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:30,126 DEBUG [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1 2023-02-17 18:01:30,126 DEBUG [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1 2023-02-17 18:01:30,126 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 885fbc7cabc4d807b5ea46913a08630f columnFamilyName f1 2023-02-17 18:01:30,127 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(310): Store=885fbc7cabc4d807b5ea46913a08630f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,127 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:30,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-17 18:01:30,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure 0edc1fa6cb68190eb80dfc8ab71e97c6, server=jenkins-hbase4.apache.org,45097,1676656887407 in 293 msec 2023-02-17 18:01:30,128 DEBUG [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b/f1 2023-02-17 18:01:30,128 DEBUG [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b/f1 2023-02-17 18:01:30,129 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb2d88a813a8a16986e91c86c7019b6b columnFamilyName f1 2023-02-17 18:01:30,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-17 18:01:30,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure a29b3043c1bf8fa8ceeba0cbadad77cf, server=jenkins-hbase4.apache.org,33675,1676656887473 in 291 msec 2023-02-17 18:01:30,129 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] regionserver.HStore(310): Store=cb2d88a813a8a16986e91c86c7019b6b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,129 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:30,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0edc1fa6cb68190eb80dfc8ab71e97c6, ASSIGN in 461 msec 2023-02-17 18:01:30,130 DEBUG [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2 2023-02-17 18:01:30,130 DEBUG [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2 2023-02-17 18:01:30,130 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 885fbc7cabc4d807b5ea46913a08630f columnFamilyName f2 2023-02-17 18:01:30,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a29b3043c1bf8fa8ceeba0cbadad77cf, ASSIGN in 463 msec 2023-02-17 18:01:30,131 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(310): Store=885fbc7cabc4d807b5ea46913a08630f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,131 DEBUG [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b/f2 2023-02-17 18:01:30,132 DEBUG [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b/f2 2023-02-17 18:01:30,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:30,132 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb2d88a813a8a16986e91c86c7019b6b columnFamilyName f2 2023-02-17 18:01:30,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:30,132 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] regionserver.HStore(310): Store=cb2d88a813a8a16986e91c86c7019b6b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:30,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:30,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:30,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:30,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:30,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 885fbc7cabc4d807b5ea46913a08630f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72486990, jitterRate=0.08014032244682312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 885fbc7cabc4d807b5ea46913a08630f: 2023-02-17 18:01:30,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:30,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f., pid=23, masterSystemTime=1676656889979 2023-02-17 18:01:30,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:30,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:30,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:30,141 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=885fbc7cabc4d807b5ea46913a08630f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,141 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676656890141"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890141"}]},"ts":"1676656890141"} 2023-02-17 18:01:30,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:30,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cb2d88a813a8a16986e91c86c7019b6b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58894018, jitterRate=-0.12241074442863464}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:30,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cb2d88a813a8a16986e91c86c7019b6b: 2023-02-17 18:01:30,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b., pid=30, masterSystemTime=1676656889988 2023-02-17 18:01:30,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:30,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:30,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-17 18:01:30,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 885fbc7cabc4d807b5ea46913a08630f, server=jenkins-hbase4.apache.org,45097,1676656887407 in 315 msec 2023-02-17 18:01:30,145 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cb2d88a813a8a16986e91c86c7019b6b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,145 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676656890145"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656890145"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656890145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656890145"}]},"ts":"1676656890145"} 2023-02-17 18:01:30,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=885fbc7cabc4d807b5ea46913a08630f, ASSIGN in 479 msec 2023-02-17 18:01:30,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-17 18:01:30,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure cb2d88a813a8a16986e91c86c7019b6b, server=jenkins-hbase4.apache.org,33675,1676656887473 in 305 msec 2023-02-17 18:01:30,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 18:01:30,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cb2d88a813a8a16986e91c86c7019b6b, ASSIGN in 482 msec 2023-02-17 18:01:30,150 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:30,150 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656890150"}]},"ts":"1676656890150"} 2023-02-17 18:01:30,151 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-17 18:01:30,153 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:30,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 665 msec 2023-02-17 18:01:30,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:30,604 INFO [Listener at localhost/46577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-17 18:01:30,604 DEBUG [Listener at localhost/46577] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-17 18:01:30,604 INFO [Listener at localhost/46577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:30,609 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-17 18:01:30,609 INFO [Listener at localhost/46577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:30,609 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-17 18:01:30,609 INFO [Listener at localhost/46577] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 18:01:30,665 DEBUG [hconnection-0x77ffd67b-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:30,683 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:30,690 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33675] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:30,702 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45097] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:30,824 INFO [Listener at localhost/46577] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 18:01:30,824 INFO [Listener at localhost/46577] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 18:01:30,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 18:01:30,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676656890825 (current time:1676656890825). 2023-02-17 18:01:30,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 18:01:30,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] zookeeper.ReadOnlyZKClient(139): Connect 0x58405a4e to 127.0.0.1:53935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:30,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e48e66d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:30,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:30,835 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60004, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:30,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58405a4e to 127.0.0.1:53935 2023-02-17 18:01:30,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:30,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 18:01:30,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 18:01:30,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 18:01:30,840 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 18:01:30,841 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676657490841 2023-02-17 18:01:30,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 18:01:30,841 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-17 18:01:30,842 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:30,842 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 18:01:30,843 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 18:01:30,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 18:01:30,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-17 18:01:30,845 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 18:01:30,846 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676657490846 2023-02-17 18:01:30,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,860 INFO [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-17 18:01:30,860 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:30,861 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-17 18:01:30,861 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-17 18:01:30,861 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,861 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,864 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,864 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:30,864 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:30,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:30,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:30,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:30,864 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,865 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:30,865 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,865 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:30,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-17 18:01:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-17 18:01:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,866 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 18:01:30,866 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-17 18:01:30,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,866 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-17 18:01:30,866 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:30,867 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-17 18:01:30,867 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:30,867 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-17 18:01:30,868 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-17 18:01:30,868 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-17 18:01:30,868 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33675,1676656887473' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-17 18:01:30,868 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-17 18:01:30,868 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45097,1676656887407' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-17 18:01:30,870 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,870 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:30,870 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,870 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,871 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:30,871 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:30,871 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,871 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:30,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33675,1676656887473' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-17 18:01:30,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c6be60c[Count = 1] remaining members to acquire global barrier 2023-02-17 18:01:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:30,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45097,1676656887407' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-17 18:01:30,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c6be60c[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:30,875 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-17 18:01:30,875 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,876 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,876 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,877 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:30,877 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-17 18:01:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,877 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-17 18:01:30,877 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:30,877 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:30,877 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. started... 2023-02-17 18:01:30,877 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:30,878 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 885fbc7cabc4d807b5ea46913a08630f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:30,878 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:30,878 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:30,878 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:30,878 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. started... 2023-02-17 18:01:30,878 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. started... 2023-02-17 18:01:30,878 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. started... 2023-02-17 18:01:30,880 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 18:01:30,880 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ff371276b52a00a0329f31e5039e1f0f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:30,881 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:30,881 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:01:30,880 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a29b3043c1bf8fa8ceeba0cbadad77cf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:30,881 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. started... 2023-02-17 18:01:30,881 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f883c8755c55162e5bdc1460cc22b78f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:30,884 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 18:01:30,884 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:01:30,885 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0edc1fa6cb68190eb80dfc8ab71e97c6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 18:01:30,885 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:30,885 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. started... 2023-02-17 18:01:30,886 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for de34f4ac261ab451cc08d3d164d0d552: 2023-02-17 18:01:30,886 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:30,886 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:30,886 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:30,886 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:30,943 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:30,968 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/.tmp/f1/d601829b0dc74d1e92e6d4ee6c9c8c5c 2023-02-17 18:01:30,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:01:30,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:30,969 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 18:01:30,981 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. completed. 2023-02-17 18:01:30,981 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:30,981 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/.tmp/f1/8b2d34f4489f46cb878e3aac8b639d41 2023-02-17 18:01:30,981 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 18:01:30,981 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:30,981 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. started... 2023-02-17 18:01:31,010 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for cb2d88a813a8a16986e91c86c7019b6b: 2023-02-17 18:01:31,010 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,010 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:31,010 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:31,010 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:31,018 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/.tmp/f1/73b50499e91d42399c8650bbb1025724 2023-02-17 18:01:31,026 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/.tmp/f1/a0647340668b4dadae9c3e23322b77b3 2023-02-17 18:01:31,033 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/.tmp/f1/33bb5cad7b50441c80f0c6c7bb3350a8 2023-02-17 18:01:31,040 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. completed. 2023-02-17 18:01:31,040 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:31,040 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:31,040 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. started... 2023-02-17 18:01:31,041 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 438412d7b22fbc75872a98e8c3225e9a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:31,041 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 18:01:31,077 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/.tmp/f2/bb7487bbd3db4e069b5a59d19baeaee2 2023-02-17 18:01:31,085 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/.tmp/f1/8b2d34f4489f46cb878e3aac8b639d41 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1/8b2d34f4489f46cb878e3aac8b639d41 2023-02-17 18:01:31,091 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1/8b2d34f4489f46cb878e3aac8b639d41, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,092 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/.tmp/f2/bb7487bbd3db4e069b5a59d19baeaee2 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2/bb7487bbd3db4e069b5a59d19baeaee2 2023-02-17 18:01:31,096 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/.tmp/f2/9e33f1c3e5f64b969882fd57e896ee01 2023-02-17 18:01:31,103 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/.tmp/f1/d601829b0dc74d1e92e6d4ee6c9c8c5c as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1/d601829b0dc74d1e92e6d4ee6c9c8c5c 2023-02-17 18:01:31,134 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/.tmp/f1/622c2f37556a44148a7f93908bd9430d 2023-02-17 18:01:31,137 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2/bb7487bbd3db4e069b5a59d19baeaee2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,139 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 885fbc7cabc4d807b5ea46913a08630f in 260ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:31,139 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-17 18:01:31,139 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 885fbc7cabc4d807b5ea46913a08630f: 2023-02-17 18:01:31,140 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,140 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:31,140 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1/8b2d34f4489f46cb878e3aac8b639d41] hfiles 2023-02-17 18:01:31,140 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1/8b2d34f4489f46cb878e3aac8b639d41 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,140 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2/bb7487bbd3db4e069b5a59d19baeaee2] hfiles 2023-02-17 18:01:31,140 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2/bb7487bbd3db4e069b5a59d19baeaee2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,145 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1/d601829b0dc74d1e92e6d4ee6c9c8c5c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,147 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/.tmp/f2/9e33f1c3e5f64b969882fd57e896ee01 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2/9e33f1c3e5f64b969882fd57e896ee01 2023-02-17 18:01:31,154 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2/9e33f1c3e5f64b969882fd57e896ee01, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,155 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a29b3043c1bf8fa8ceeba0cbadad77cf in 275ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:31,164 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a29b3043c1bf8fa8ceeba0cbadad77cf: 2023-02-17 18:01:31,165 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,165 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:31,165 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1/d601829b0dc74d1e92e6d4ee6c9c8c5c] hfiles 2023-02-17 18:01:31,165 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1/d601829b0dc74d1e92e6d4ee6c9c8c5c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,165 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2/9e33f1c3e5f64b969882fd57e896ee01] hfiles 2023-02-17 18:01:31,165 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2/9e33f1c3e5f64b969882fd57e896ee01 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,169 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:31,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:01:31,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:31,172 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-17 18:01:31,174 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/.tmp/f2/934df325a60847e489b3216d71652423 2023-02-17 18:01:31,195 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/.tmp/f1/a0647340668b4dadae9c3e23322b77b3 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1/a0647340668b4dadae9c3e23322b77b3 2023-02-17 18:01:31,196 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. completed. 2023-02-17 18:01:31,196 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:31,196 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:31,196 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 18:01:31,196 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. started... 2023-02-17 18:01:31,196 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4296cab86e8af48c221caaf0e166a525 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:31,204 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/.tmp/f2/3317e8d21b46485e8d083147332a7b06 2023-02-17 18:01:31,206 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1/a0647340668b4dadae9c3e23322b77b3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,214 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/.tmp/f2/934df325a60847e489b3216d71652423 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2/934df325a60847e489b3216d71652423 2023-02-17 18:01:31,224 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/.tmp/f1/622c2f37556a44148a7f93908bd9430d as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1/622c2f37556a44148a7f93908bd9430d 2023-02-17 18:01:31,225 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2/934df325a60847e489b3216d71652423, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,227 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ff371276b52a00a0329f31e5039e1f0f in 347ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:31,227 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ff371276b52a00a0329f31e5039e1f0f: 2023-02-17 18:01:31,227 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,227 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:31,227 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1/a0647340668b4dadae9c3e23322b77b3] hfiles 2023-02-17 18:01:31,227 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1/a0647340668b4dadae9c3e23322b77b3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,227 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2/934df325a60847e489b3216d71652423] hfiles 2023-02-17 18:01:31,227 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2/934df325a60847e489b3216d71652423 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,233 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. completed. 2023-02-17 18:01:31,233 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:31,233 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 18:01:31,235 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1/622c2f37556a44148a7f93908bd9430d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,236 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/.tmp/f2/3317e8d21b46485e8d083147332a7b06 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2/3317e8d21b46485e8d083147332a7b06 2023-02-17 18:01:31,241 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/.tmp/f1/8bf4537c633f48d5b5f3b75ad9b11fb6 2023-02-17 18:01:31,257 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2/3317e8d21b46485e8d083147332a7b06, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,259 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 438412d7b22fbc75872a98e8c3225e9a in 218ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:31,259 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 438412d7b22fbc75872a98e8c3225e9a: 2023-02-17 18:01:31,260 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,260 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:31,260 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1/622c2f37556a44148a7f93908bd9430d] hfiles 2023-02-17 18:01:31,260 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1/622c2f37556a44148a7f93908bd9430d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,261 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2/3317e8d21b46485e8d083147332a7b06] hfiles 2023-02-17 18:01:31,261 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2/3317e8d21b46485e8d083147332a7b06 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,279 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. completed. 2023-02-17 18:01:31,279 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:31,279 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 18:01:31,294 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. completed. 2023-02-17 18:01:31,294 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:31,294 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 18:01:31,294 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 18:01:31,294 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,294 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-17 18:01:31,294 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,33675,1676656887473' in zk 2023-02-17 18:01:31,297 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,297 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-17 18:01:31,298 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:31,298 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-17 18:01:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:31,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:31,308 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/.tmp/f2/663b3663802c4203826a1721f452d7bd 2023-02-17 18:01:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:31,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,33675,1676656887473': 2023-02-17 18:01:31,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33675,1676656887473' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 18:01:31,320 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/.tmp/f1/8bf4537c633f48d5b5f3b75ad9b11fb6 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1/8bf4537c633f48d5b5f3b75ad9b11fb6 2023-02-17 18:01:31,328 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1/8bf4537c633f48d5b5f3b75ad9b11fb6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,329 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/.tmp/f2/663b3663802c4203826a1721f452d7bd as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2/663b3663802c4203826a1721f452d7bd 2023-02-17 18:01:31,336 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2/663b3663802c4203826a1721f452d7bd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,337 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4296cab86e8af48c221caaf0e166a525 in 141ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:31,337 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4296cab86e8af48c221caaf0e166a525: 2023-02-17 18:01:31,337 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,337 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:31,337 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1/8bf4537c633f48d5b5f3b75ad9b11fb6] hfiles 2023-02-17 18:01:31,337 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1/8bf4537c633f48d5b5f3b75ad9b11fb6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,337 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2/663b3663802c4203826a1721f452d7bd] hfiles 2023-02-17 18:01:31,337 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2/663b3663802c4203826a1721f452d7bd for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,368 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. completed. 2023-02-17 18:01:31,368 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:31,369 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:31,369 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 18:01:31,369 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. started... 2023-02-17 18:01:31,369 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9aa47450c18159eb010cbd44a0b38896 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 18:01:31,472 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:31,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:01:31,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:31,474 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-17 18:01:31,513 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/.tmp/f2/1fb02151987141bb9c7690cca6700fad 2023-02-17 18:01:31,519 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/.tmp/f1/33bb5cad7b50441c80f0c6c7bb3350a8 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1/33bb5cad7b50441c80f0c6c7bb3350a8 2023-02-17 18:01:31,526 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1/33bb5cad7b50441c80f0c6c7bb3350a8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,527 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/.tmp/f2/1fb02151987141bb9c7690cca6700fad as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2/1fb02151987141bb9c7690cca6700fad 2023-02-17 18:01:31,726 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/.tmp/f2/450220f492cc4343bdde81532c931255 2023-02-17 18:01:31,727 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2/1fb02151987141bb9c7690cca6700fad, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:31,728 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f883c8755c55162e5bdc1460cc22b78f in 848ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:31,728 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f883c8755c55162e5bdc1460cc22b78f: 2023-02-17 18:01:31,729 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,729 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:31,729 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1/33bb5cad7b50441c80f0c6c7bb3350a8] hfiles 2023-02-17 18:01:31,729 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1/33bb5cad7b50441c80f0c6c7bb3350a8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,729 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2/1fb02151987141bb9c7690cca6700fad] hfiles 2023-02-17 18:01:31,729 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2/1fb02151987141bb9c7690cca6700fad for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,735 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/.tmp/f1/73b50499e91d42399c8650bbb1025724 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1/73b50499e91d42399c8650bbb1025724 2023-02-17 18:01:31,740 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. completed. 2023-02-17 18:01:31,740 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:31,740 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 18:01:31,742 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1/73b50499e91d42399c8650bbb1025724, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:31,743 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/.tmp/f2/450220f492cc4343bdde81532c931255 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2/450220f492cc4343bdde81532c931255 2023-02-17 18:01:31,749 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2/450220f492cc4343bdde81532c931255, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:31,750 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 0edc1fa6cb68190eb80dfc8ab71e97c6 in 865ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:31,750 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0edc1fa6cb68190eb80dfc8ab71e97c6: 2023-02-17 18:01:31,751 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,751 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:31,751 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1/73b50499e91d42399c8650bbb1025724] hfiles 2023-02-17 18:01:31,751 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1/73b50499e91d42399c8650bbb1025724 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,751 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2/450220f492cc4343bdde81532c931255] hfiles 2023-02-17 18:01:31,751 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2/450220f492cc4343bdde81532c931255 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,768 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. completed. 2023-02-17 18:01:31,768 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:31,768 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 18:01:31,801 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/.tmp/f1/9c2cf064dcb94442a91e9a98401ea08d 2023-02-17 18:01:31,832 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/.tmp/f2/2ba98dafd3894d3e84bf11bcb4815147 2023-02-17 18:01:31,837 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/.tmp/f1/9c2cf064dcb94442a91e9a98401ea08d as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1/9c2cf064dcb94442a91e9a98401ea08d 2023-02-17 18:01:31,842 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1/9c2cf064dcb94442a91e9a98401ea08d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:31,843 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/.tmp/f2/2ba98dafd3894d3e84bf11bcb4815147 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2/2ba98dafd3894d3e84bf11bcb4815147 2023-02-17 18:01:31,847 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2/2ba98dafd3894d3e84bf11bcb4815147, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:31,848 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 9aa47450c18159eb010cbd44a0b38896 in 479ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:31,848 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9aa47450c18159eb010cbd44a0b38896: 2023-02-17 18:01:31,848 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,848 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:31,848 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1/9c2cf064dcb94442a91e9a98401ea08d] hfiles 2023-02-17 18:01:31,848 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1/9c2cf064dcb94442a91e9a98401ea08d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,849 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2/2ba98dafd3894d3e84bf11bcb4815147] hfiles 2023-02-17 18:01:31,849 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2/2ba98dafd3894d3e84bf11bcb4815147 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,858 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. completed. 2023-02-17 18:01:31,859 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:31,859 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 18:01:31,859 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 18:01:31,859 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,859 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-17 18:01:31,859 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,45097,1676656887407' in zk 2023-02-17 18:01:31,861 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,861 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-17 18:01:31,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:31,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:31,861 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:31,861 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-17 18:01:31,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:31,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:31,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:31,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,45097,1676656887407': 2023-02-17 18:01:31,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45097,1676656887407' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 18:01:31,865 INFO [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-17 18:01:31,865 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:31,865 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:31,866 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,866 INFO [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 18:01:31,867 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,867 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:31,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:31,867 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:31,867 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,868 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:31,868 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:31,869 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:31,871 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,871 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,878 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,878 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:31,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:31,878 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:31,878 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:31,878 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:31,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:31,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:31,878 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:31,878 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,879 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,880 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:31,880 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,880 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:31,880 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,880 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:31,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:31,879 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:31,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:31,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:31,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:31,974 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:31,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:01:31,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:31,976 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-17 18:01:32,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:32,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-17 18:01:32,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:32,367 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:32,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676656890841Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676656891879 (+1038 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676656891879Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676656891896 (+17 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676656892319 (+423 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676656892366 (+47 ms) 2023-02-17 18:01:32,368 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 18:01:32,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.5260 sec 2023-02-17 18:01:32,977 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:32,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:01:32,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 18:01:32,979 INFO [Listener at localhost/46577] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 18:01:32,984 INFO [Listener at localhost/46577] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 18:01:32,992 INFO [Listener at localhost/46577] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 18:01:33,030 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33675] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:33,045 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45097] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:33,128 INFO [Listener at localhost/46577] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 18:01:33,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 18:01:33,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-17 18:01:33,137 INFO [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-17 18:01:33,138 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:33,138 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-17 18:01:33,138 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-17 18:01:33,139 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,139 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:33,140 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:33,140 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:33,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:33,140 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:33,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:33,141 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,141 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:33,141 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,141 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:33,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:33,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 18:01:33,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 18:01:33,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 18:01:33,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 18:01:33,142 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 18:01:33,142 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:33,144 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 18:01:33,144 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 18:01:33,145 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:33,145 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:33,145 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. started... 2023-02-17 18:01:33,145 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 885fbc7cabc4d807b5ea46913a08630f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:33,146 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 18:01:33,146 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:33,146 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. started... 2023-02-17 18:01:33,146 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f883c8755c55162e5bdc1460cc22b78f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:33,147 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 18:01:33,148 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:33,148 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 18:01:33,149 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:01:33,148 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:01:33,148 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:33,148 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. started... 2023-02-17 18:01:33,148 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:33,149 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. started... 2023-02-17 18:01:33,149 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0edc1fa6cb68190eb80dfc8ab71e97c6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 18:01:33,149 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. started... 2023-02-17 18:01:33,149 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a29b3043c1bf8fa8ceeba0cbadad77cf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:33,149 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for de34f4ac261ab451cc08d3d164d0d552: 2023-02-17 18:01:33,149 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:33,149 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:33,149 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 18:01:33,149 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. started... 2023-02-17 18:01:33,149 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cb2d88a813a8a16986e91c86c7019b6b: 2023-02-17 18:01:33,149 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:33,150 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:33,150 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 18:01:33,150 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. started... 2023-02-17 18:01:33,150 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:33,151 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. started... 2023-02-17 18:01:33,151 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 438412d7b22fbc75872a98e8c3225e9a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:33,151 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ff371276b52a00a0329f31e5039e1f0f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:33,188 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/.tmp/f1/39d8c00b49504e7eba60314e4ee3c419 2023-02-17 18:01:33,189 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/.tmp/f1/25bca6f97eac47468aa320dd610a55c5 2023-02-17 18:01:33,202 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/.tmp/f1/96c7c0d5b03a481e96f8791fe3459b6c 2023-02-17 18:01:33,220 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/.tmp/f1/3c694c37b065434faa174dec5867ac17 2023-02-17 18:01:33,220 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/.tmp/f1/a9ad4007590746d3845c8080d87622ca 2023-02-17 18:01:33,248 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/.tmp/f2/365d9aad22db4a4da7433835cccec7ec 2023-02-17 18:01:33,249 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/.tmp/f2/d68836b0da7a4d7dbf39e99aa3362581 2023-02-17 18:01:33,256 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/.tmp/f1/39d8c00b49504e7eba60314e4ee3c419 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1/39d8c00b49504e7eba60314e4ee3c419 2023-02-17 18:01:33,257 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/.tmp/f1/96c7c0d5b03a481e96f8791fe3459b6c as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1/96c7c0d5b03a481e96f8791fe3459b6c 2023-02-17 18:01:33,261 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/.tmp/f2/f2ceba546a794ea281a48e281aea692c 2023-02-17 18:01:33,262 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1/39d8c00b49504e7eba60314e4ee3c419, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,264 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/.tmp/f2/d68836b0da7a4d7dbf39e99aa3362581 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2/d68836b0da7a4d7dbf39e99aa3362581 2023-02-17 18:01:33,264 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1/96c7c0d5b03a481e96f8791fe3459b6c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,265 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/.tmp/f2/365d9aad22db4a4da7433835cccec7ec as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2/365d9aad22db4a4da7433835cccec7ec 2023-02-17 18:01:33,271 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2/d68836b0da7a4d7dbf39e99aa3362581, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,272 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/.tmp/f1/25bca6f97eac47468aa320dd610a55c5 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1/25bca6f97eac47468aa320dd610a55c5 2023-02-17 18:01:33,273 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 438412d7b22fbc75872a98e8c3225e9a in 123ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:33,273 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 438412d7b22fbc75872a98e8c3225e9a: 2023-02-17 18:01:33,273 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:33,273 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 18:01:33,277 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2/365d9aad22db4a4da7433835cccec7ec, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,278 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/.tmp/f2/6629012216f64e21b556a8cdfa6464d1 2023-02-17 18:01:33,278 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f883c8755c55162e5bdc1460cc22b78f in 132ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:33,278 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f883c8755c55162e5bdc1460cc22b78f: 2023-02-17 18:01:33,278 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:33,278 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:33,278 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. started... 2023-02-17 18:01:33,278 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4296cab86e8af48c221caaf0e166a525 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:33,278 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 18:01:33,280 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1/25bca6f97eac47468aa320dd610a55c5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:33,280 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/.tmp/f2/265a56bc9e384781a252c8ed0adfcc54 2023-02-17 18:01:33,285 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/.tmp/f2/f2ceba546a794ea281a48e281aea692c as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2/f2ceba546a794ea281a48e281aea692c 2023-02-17 18:01:33,289 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/.tmp/f1/3c694c37b065434faa174dec5867ac17 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1/3c694c37b065434faa174dec5867ac17 2023-02-17 18:01:33,294 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/.tmp/f1/a9ad4007590746d3845c8080d87622ca as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1/a9ad4007590746d3845c8080d87622ca 2023-02-17 18:01:33,295 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1/3c694c37b065434faa174dec5867ac17, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,295 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2/f2ceba546a794ea281a48e281aea692c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:33,296 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 0edc1fa6cb68190eb80dfc8ab71e97c6 in 147ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:33,296 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/.tmp/f2/6629012216f64e21b556a8cdfa6464d1 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2/6629012216f64e21b556a8cdfa6464d1 2023-02-17 18:01:33,296 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0edc1fa6cb68190eb80dfc8ab71e97c6: 2023-02-17 18:01:33,297 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:33,297 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:33,297 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 18:01:33,297 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. started... 2023-02-17 18:01:33,297 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9aa47450c18159eb010cbd44a0b38896 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 18:01:33,306 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1/a9ad4007590746d3845c8080d87622ca, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,307 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/.tmp/f2/265a56bc9e384781a252c8ed0adfcc54 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2/265a56bc9e384781a252c8ed0adfcc54 2023-02-17 18:01:33,309 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2/6629012216f64e21b556a8cdfa6464d1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,310 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ff371276b52a00a0329f31e5039e1f0f in 159ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:33,310 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ff371276b52a00a0329f31e5039e1f0f: 2023-02-17 18:01:33,310 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:33,310 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 18:01:33,315 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2/265a56bc9e384781a252c8ed0adfcc54, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,316 INFO [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a29b3043c1bf8fa8ceeba0cbadad77cf in 167ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:33,316 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a29b3043c1bf8fa8ceeba0cbadad77cf: 2023-02-17 18:01:33,316 DEBUG [rs(jenkins-hbase4.apache.org,33675,1676656887473)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:33,316 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 18:01:33,316 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 18:01:33,316 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,316 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 18:01:33,316 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33675,1676656887473' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 18:01:33,318 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,318 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:33,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:33,319 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/.tmp/f1/c874e3e3763a4d82b96791681a25908a 2023-02-17 18:01:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:33,319 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,319 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:33,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:33,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33675,1676656887473' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 18:01:33,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18547159[Count = 1] remaining members to acquire global barrier 2023-02-17 18:01:33,333 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/.tmp/f2/3108889f3f1f4506848739729d789c97 2023-02-17 18:01:33,338 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/.tmp/f1/c874e3e3763a4d82b96791681a25908a as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1/c874e3e3763a4d82b96791681a25908a 2023-02-17 18:01:33,342 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1/c874e3e3763a4d82b96791681a25908a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:33,343 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/.tmp/f2/3108889f3f1f4506848739729d789c97 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2/3108889f3f1f4506848739729d789c97 2023-02-17 18:01:33,347 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2/3108889f3f1f4506848739729d789c97, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:33,348 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 9aa47450c18159eb010cbd44a0b38896 in 51ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:33,348 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9aa47450c18159eb010cbd44a0b38896: 2023-02-17 18:01:33,348 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:33,348 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 18:01:33,584 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/.tmp/f1/adbf10bdf6aa462784164bc3f43f52be 2023-02-17 18:01:33,597 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/.tmp/f2/62b23c56614e46809105b4487b0dc35e 2023-02-17 18:01:33,602 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/.tmp/f1/adbf10bdf6aa462784164bc3f43f52be as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1/adbf10bdf6aa462784164bc3f43f52be 2023-02-17 18:01:33,608 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1/adbf10bdf6aa462784164bc3f43f52be, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,609 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/.tmp/f2/62b23c56614e46809105b4487b0dc35e as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2/62b23c56614e46809105b4487b0dc35e 2023-02-17 18:01:33,614 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2/62b23c56614e46809105b4487b0dc35e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,615 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 885fbc7cabc4d807b5ea46913a08630f in 470ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:33,615 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 885fbc7cabc4d807b5ea46913a08630f: 2023-02-17 18:01:33,615 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:33,615 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 18:01:33,702 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/.tmp/f1/913e1003e2d541bfa42249074f37fa73 2023-02-17 18:01:33,726 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/.tmp/f2/37959a3bd6c343e18fe3200f85ea339a 2023-02-17 18:01:33,733 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/.tmp/f1/913e1003e2d541bfa42249074f37fa73 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1/913e1003e2d541bfa42249074f37fa73 2023-02-17 18:01:33,739 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1/913e1003e2d541bfa42249074f37fa73, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,740 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/.tmp/f2/37959a3bd6c343e18fe3200f85ea339a as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2/37959a3bd6c343e18fe3200f85ea339a 2023-02-17 18:01:33,744 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2/37959a3bd6c343e18fe3200f85ea339a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:33,745 INFO [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4296cab86e8af48c221caaf0e166a525 in 467ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:33,745 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4296cab86e8af48c221caaf0e166a525: 2023-02-17 18:01:33,745 DEBUG [rs(jenkins-hbase4.apache.org,45097,1676656887407)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:33,745 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 18:01:33,745 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 18:01:33,745 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,745 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 18:01:33,745 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45097,1676656887407' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 18:01:33,747 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,747 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:33,747 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,747 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:33,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45097,1676656887407' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 18:01:33,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18547159[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:33,749 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-17 18:01:33,749 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,752 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,752 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 18:01:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 18:01:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 18:01:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 18:01:33,752 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45097,1676656887407' in zk 2023-02-17 18:01:33,752 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33675,1676656887473' in zk 2023-02-17 18:01:33,753 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,753 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:33,754 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 18:01:33,754 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:33,754 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,754 DEBUG [member: 'jenkins-hbase4.apache.org,45097,1676656887407' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 18:01:33,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:33,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:33,755 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 18:01:33,755 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,755 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:33,755 DEBUG [member: 'jenkins-hbase4.apache.org,33675,1676656887473' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 18:01:33,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:33,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:33,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:33,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45097,1676656887407': 2023-02-17 18:01:33,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45097,1676656887407' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-17 18:01:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:33,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:33,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,33675,1676656887473': 2023-02-17 18:01:33,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33675,1676656887473' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-17 18:01:33,763 INFO [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-17 18:01:33,763 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:33,763 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:33,763 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-17 18:01:33,763 INFO [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 18:01:33,765 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,765 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,765 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:33,765 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:33,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,765 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:33,766 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:33,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:33,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,766 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:33,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:33,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:33,768 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:01:33,768 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,772 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,772 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:33,772 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:33,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:33,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:33,773 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:33,773 DEBUG [(jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:33,773 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-17 18:01:33,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 18:01:33,773 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:33,774 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:01:33,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:33,774 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,774 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:33,774 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:33,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:33,774 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:33,774 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,774 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 18:01:33,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:33,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:33,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:33,774 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:01:33,775 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:01:33,874 DEBUG [Listener at localhost/46577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 18:01:33,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41793] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 18:01:33,876 INFO [Listener at localhost/46577] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 18:01:33,877 DEBUG [Listener at localhost/46577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2098ea7a to 127.0.0.1:53935 2023-02-17 18:01:33,877 DEBUG [Listener at localhost/46577] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:33,877 DEBUG [Listener at localhost/46577] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 18:01:33,877 DEBUG [Listener at localhost/46577] util.JVMClusterUtil(257): Found active master hash=789109570, stopped=false 2023-02-17 18:01:33,877 INFO [Listener at localhost/46577] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:33,878 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:33,879 INFO [Listener at localhost/46577] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 18:01:33,879 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:33,879 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:33,878 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:33,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:33,880 DEBUG [Listener at localhost/46577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3617732d to 127.0.0.1:53935 2023-02-17 18:01:33,881 DEBUG [Listener at localhost/46577] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:33,881 INFO [Listener at localhost/46577] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45097,1676656887407' ***** 2023-02-17 18:01:33,881 INFO [Listener at localhost/46577] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:33,881 INFO [Listener at localhost/46577] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33675,1676656887473' ***** 2023-02-17 18:01:33,881 INFO [RS:0;jenkins-hbase4:45097] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:33,881 INFO [RS:0;jenkins-hbase4:45097] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:33,881 INFO [RS:0;jenkins-hbase4:45097] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:33,881 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(3304): Received CLOSE for 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:33,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:33,882 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(3304): Received CLOSE for f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:33,882 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(3304): Received CLOSE for 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:33,882 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(3304): Received CLOSE for 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:33,882 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(3304): Received CLOSE for 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:33,882 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(3304): Received CLOSE for e0bd631e9793d46639c221ee502f833b 2023-02-17 18:01:33,882 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:33,882 DEBUG [RS:0;jenkins-hbase4:45097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21746dc4 to 127.0.0.1:53935 2023-02-17 18:01:33,882 DEBUG [RS:0;jenkins-hbase4:45097] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:33,881 INFO [Listener at localhost/46577] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:33,883 INFO [RS:0;jenkins-hbase4:45097] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:33,883 INFO [RS:0;jenkins-hbase4:45097] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:33,883 INFO [RS:1;jenkins-hbase4:33675] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:33,883 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:33,883 INFO [RS:1;jenkins-hbase4:33675] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:33,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:33,881 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:33,883 INFO [RS:1;jenkins-hbase4:33675] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:33,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 885fbc7cabc4d807b5ea46913a08630f, disabling compactions & flushes 2023-02-17 18:01:33,883 INFO [RS:0;jenkins-hbase4:45097] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:33,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:33,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:33,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. after waiting 0 ms 2023-02-17 18:01:33,885 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(3304): Received CLOSE for a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:33,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:33,886 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 18:01:33,886 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(3304): Received CLOSE for ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:33,886 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(3304): Received CLOSE for de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:33,886 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-17 18:01:33,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a29b3043c1bf8fa8ceeba0cbadad77cf, disabling compactions & flushes 2023-02-17 18:01:33,886 DEBUG [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1479): Online Regions={885fbc7cabc4d807b5ea46913a08630f=testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f., f883c8755c55162e5bdc1460cc22b78f=testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f., 0edc1fa6cb68190eb80dfc8ab71e97c6=testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6., 1588230740=hbase:meta,,1.1588230740, 4296cab86e8af48c221caaf0e166a525=testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525., 9aa47450c18159eb010cbd44a0b38896=testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896., e0bd631e9793d46639c221ee502f833b=hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b.} 2023-02-17 18:01:33,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:33,886 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:33,886 DEBUG [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1505): Waiting on 0edc1fa6cb68190eb80dfc8ab71e97c6, 1588230740, 4296cab86e8af48c221caaf0e166a525, 885fbc7cabc4d807b5ea46913a08630f, 9aa47450c18159eb010cbd44a0b38896, e0bd631e9793d46639c221ee502f833b, f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:33,886 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(3304): Received CLOSE for cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:33,886 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:33,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:33,887 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:33,887 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(3304): Received CLOSE for 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:33,889 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:33,890 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:33,890 DEBUG [RS:1;jenkins-hbase4:33675] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a6aa4a3 to 127.0.0.1:53935 2023-02-17 18:01:33,890 DEBUG [RS:1;jenkins-hbase4:33675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:33,890 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-17 18:01:33,890 DEBUG [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1479): Online Regions={a29b3043c1bf8fa8ceeba0cbadad77cf=testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf., ff371276b52a00a0329f31e5039e1f0f=testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f., de34f4ac261ab451cc08d3d164d0d552=testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552., cb2d88a813a8a16986e91c86c7019b6b=testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b., 438412d7b22fbc75872a98e8c3225e9a=testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.} 2023-02-17 18:01:33,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. after waiting 0 ms 2023-02-17 18:01:33,891 DEBUG [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1505): Waiting on 438412d7b22fbc75872a98e8c3225e9a, a29b3043c1bf8fa8ceeba0cbadad77cf, cb2d88a813a8a16986e91c86c7019b6b, de34f4ac261ab451cc08d3d164d0d552, ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:33,890 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:33,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:33,891 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-17 18:01:33,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:33,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:33,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a29b3043c1bf8fa8ceeba0cbadad77cf: 2023-02-17 18:01:33,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:33,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ff371276b52a00a0329f31e5039e1f0f, disabling compactions & flushes 2023-02-17 18:01:33,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:33,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:33,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. after waiting 0 ms 2023-02-17 18:01:33,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:33,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:33,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 885fbc7cabc4d807b5ea46913a08630f: 2023-02-17 18:01:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f883c8755c55162e5bdc1460cc22b78f, disabling compactions & flushes 2023-02-17 18:01:33,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. after waiting 0 ms 2023-02-17 18:01:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:33,925 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:33,925 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:33,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:33,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:33,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ff371276b52a00a0329f31e5039e1f0f: 2023-02-17 18:01:33,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:33,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing de34f4ac261ab451cc08d3d164d0d552, disabling compactions & flushes 2023-02-17 18:01:33,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:33,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:33,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. after waiting 0 ms 2023-02-17 18:01:33,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:33,936 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/.tmp/info/3035db8bd2c645ceb90c58094290712d 2023-02-17 18:01:33,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:33,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:33,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f883c8755c55162e5bdc1460cc22b78f: 2023-02-17 18:01:33,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:33,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0edc1fa6cb68190eb80dfc8ab71e97c6, disabling compactions & flushes 2023-02-17 18:01:33,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:33,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:33,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. after waiting 0 ms 2023-02-17 18:01:33,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 18:01:33,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for de34f4ac261ab451cc08d3d164d0d552: 2023-02-17 18:01:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cb2d88a813a8a16986e91c86c7019b6b, disabling compactions & flushes 2023-02-17 18:01:33,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:33,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:33,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. after waiting 0 ms 2023-02-17 18:01:33,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:33,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/.tmp/table/118bb1d6310d484cb5085e2315414975 2023-02-17 18:01:33,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 18:01:33,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:33,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cb2d88a813a8a16986e91c86c7019b6b: 2023-02-17 18:01:33,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:33,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 438412d7b22fbc75872a98e8c3225e9a, disabling compactions & flushes 2023-02-17 18:01:33,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:33,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:33,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. after waiting 0 ms 2023-02-17 18:01:33,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:33,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:33,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/.tmp/info/3035db8bd2c645ceb90c58094290712d as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/info/3035db8bd2c645ceb90c58094290712d 2023-02-17 18:01:33,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0edc1fa6cb68190eb80dfc8ab71e97c6: 2023-02-17 18:01:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4296cab86e8af48c221caaf0e166a525, disabling compactions & flushes 2023-02-17 18:01:33,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. after waiting 0 ms 2023-02-17 18:01:33,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:33,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:33,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:33,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 438412d7b22fbc75872a98e8c3225e9a: 2023-02-17 18:01:33,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:33,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:33,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/info/3035db8bd2c645ceb90c58094290712d, entries=110, sequenceid=32, filesize=18.7 K 2023-02-17 18:01:33,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:33,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4296cab86e8af48c221caaf0e166a525: 2023-02-17 18:01:33,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/.tmp/table/118bb1d6310d484cb5085e2315414975 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/table/118bb1d6310d484cb5085e2315414975 2023-02-17 18:01:33,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:33,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9aa47450c18159eb010cbd44a0b38896, disabling compactions & flushes 2023-02-17 18:01:33,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:33,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:33,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. after waiting 0 ms 2023-02-17 18:01:33,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:33,997 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/table/118bb1d6310d484cb5085e2315414975, entries=4, sequenceid=32, filesize=4.8 K 2023-02-17 18:01:34,001 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 110ms, sequenceid=32, compaction requested=false 2023-02-17 18:01:34,002 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-17 18:01:34,004 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:34,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:34,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9aa47450c18159eb010cbd44a0b38896: 2023-02-17 18:01:34,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:34,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e0bd631e9793d46639c221ee502f833b, disabling compactions & flushes 2023-02-17 18:01:34,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:34,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:34,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. after waiting 0 ms 2023-02-17 18:01:34,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:34,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e0bd631e9793d46639c221ee502f833b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 18:01:34,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-17 18:01:34,010 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 18:01:34,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:34,010 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:34,010 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:34,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b/.tmp/info/7da7a01efb164177982a8942b9596fc4 2023-02-17 18:01:34,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b/.tmp/info/7da7a01efb164177982a8942b9596fc4 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b/info/7da7a01efb164177982a8942b9596fc4 2023-02-17 18:01:34,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b/info/7da7a01efb164177982a8942b9596fc4, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 18:01:34,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e0bd631e9793d46639c221ee502f833b in 22ms, sequenceid=6, compaction requested=false 2023-02-17 18:01:34,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-17 18:01:34,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/data/hbase/namespace/e0bd631e9793d46639c221ee502f833b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 18:01:34,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:34,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e0bd631e9793d46639c221ee502f833b: 2023-02-17 18:01:34,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676656888827.e0bd631e9793d46639c221ee502f833b. 2023-02-17 18:01:34,086 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45097,1676656887407; all regions closed. 2023-02-17 18:01:34,091 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33675,1676656887473; all regions closed. 2023-02-17 18:01:34,095 DEBUG [RS:0;jenkins-hbase4:45097] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/oldWALs 2023-02-17 18:01:34,095 INFO [RS:0;jenkins-hbase4:45097] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45097%2C1676656887407.meta:.meta(num 1676656888740) 2023-02-17 18:01:34,101 DEBUG [RS:1;jenkins-hbase4:33675] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/oldWALs 2023-02-17 18:01:34,101 INFO [RS:1;jenkins-hbase4:33675] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33675%2C1676656887473:(num 1676656889572) 2023-02-17 18:01:34,102 DEBUG [RS:1;jenkins-hbase4:33675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:34,102 INFO [RS:1;jenkins-hbase4:33675] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:34,102 INFO [RS:1;jenkins-hbase4:33675] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:34,102 INFO [RS:1;jenkins-hbase4:33675] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:34,102 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:34,102 INFO [RS:1;jenkins-hbase4:33675] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:34,102 INFO [RS:1;jenkins-hbase4:33675] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:34,103 INFO [RS:1;jenkins-hbase4:33675] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33675 2023-02-17 18:01:34,105 DEBUG [RS:0;jenkins-hbase4:45097] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/oldWALs 2023-02-17 18:01:34,105 INFO [RS:0;jenkins-hbase4:45097] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45097%2C1676656887407:(num 1676656889210) 2023-02-17 18:01:34,105 DEBUG [RS:0;jenkins-hbase4:45097] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:34,105 INFO [RS:0;jenkins-hbase4:45097] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:34,106 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:34,106 INFO [RS:0;jenkins-hbase4:45097] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:34,106 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:34,106 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33675,1676656887473 2023-02-17 18:01:34,106 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:34,106 ERROR [Listener at localhost/46577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35ae1f44 rejected from java.util.concurrent.ThreadPoolExecutor@31918d29[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:34,106 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:34,106 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:34,107 ERROR [Listener at localhost/46577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@bc7e9a rejected from java.util.concurrent.ThreadPoolExecutor@31918d29[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:34,107 INFO [RS:0;jenkins-hbase4:45097] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45097 2023-02-17 18:01:34,107 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33675,1676656887473] 2023-02-17 18:01:34,108 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33675,1676656887473; numProcessing=1 2023-02-17 18:01:34,110 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45097,1676656887407 2023-02-17 18:01:34,110 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:34,110 ERROR [Listener at localhost/46577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13230a0f rejected from java.util.concurrent.ThreadPoolExecutor@171c8cb3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:34,112 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33675,1676656887473 already deleted, retry=false 2023-02-17 18:01:34,112 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33675,1676656887473 expired; onlineServers=1 2023-02-17 18:01:34,113 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45097,1676656887407] 2023-02-17 18:01:34,113 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45097,1676656887407; numProcessing=2 2023-02-17 18:01:34,114 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45097,1676656887407 already deleted, retry=false 2023-02-17 18:01:34,114 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45097,1676656887407 expired; onlineServers=0 2023-02-17 18:01:34,114 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41793,1676656886771' ***** 2023-02-17 18:01:34,114 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 18:01:34,115 DEBUG [M:0;jenkins-hbase4:41793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e35d179, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:34,115 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41793,1676656886771 2023-02-17 18:01:34,115 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41793,1676656886771; all regions closed. 2023-02-17 18:01:34,115 DEBUG [M:0;jenkins-hbase4:41793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:34,115 DEBUG [M:0;jenkins-hbase4:41793] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 18:01:34,115 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 18:01:34,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656888371] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656888371,5,FailOnTimeoutGroup] 2023-02-17 18:01:34,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656888371] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656888371,5,FailOnTimeoutGroup] 2023-02-17 18:01:34,115 DEBUG [M:0;jenkins-hbase4:41793] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 18:01:34,117 INFO [M:0;jenkins-hbase4:41793] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 18:01:34,117 INFO [M:0;jenkins-hbase4:41793] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 18:01:34,117 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:34,117 INFO [M:0;jenkins-hbase4:41793] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 18:01:34,117 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:34,117 DEBUG [M:0;jenkins-hbase4:41793] master.HMaster(1512): Stopping service threads 2023-02-17 18:01:34,117 INFO [M:0;jenkins-hbase4:41793] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 18:01:34,118 ERROR [M:0;jenkins-hbase4:41793] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 18:01:34,118 INFO [M:0;jenkins-hbase4:41793] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 18:01:34,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:34,118 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 18:01:34,118 DEBUG [M:0;jenkins-hbase4:41793] zookeeper.ZKUtil(398): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 18:01:34,118 WARN [M:0;jenkins-hbase4:41793] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 18:01:34,118 INFO [M:0;jenkins-hbase4:41793] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 18:01:34,119 INFO [M:0;jenkins-hbase4:41793] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 18:01:34,119 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:34,119 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:34,119 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:34,119 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:34,119 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:34,119 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-17 18:01:34,128 INFO [M:0;jenkins-hbase4:41793] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2e9eeca73dea41749b1625f3b93bd262 2023-02-17 18:01:34,133 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2e9eeca73dea41749b1625f3b93bd262 as hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2e9eeca73dea41749b1625f3b93bd262 2023-02-17 18:01:34,138 INFO [M:0;jenkins-hbase4:41793] regionserver.HStore(1080): Added hdfs://localhost:44339/user/jenkins/test-data/f1d23f40-3b6f-44c2-55c1-8cfc8a6f15af/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2e9eeca73dea41749b1625f3b93bd262, entries=31, sequenceid=218, filesize=9.0 K 2023-02-17 18:01:34,139 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-17 18:01:34,139 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:34,139 DEBUG [M:0;jenkins-hbase4:41793] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:34,143 INFO [M:0;jenkins-hbase4:41793] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 18:01:34,143 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:34,144 INFO [M:0;jenkins-hbase4:41793] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41793 2023-02-17 18:01:34,149 DEBUG [M:0;jenkins-hbase4:41793] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41793,1676656886771 already deleted, retry=false 2023-02-17 18:01:34,263 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 18:01:34,291 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:34,291 INFO [M:0;jenkins-hbase4:41793] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41793,1676656886771; zookeeper connection closed. 2023-02-17 18:01:34,291 ERROR [Listener at localhost/46577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76c150c3 rejected from java.util.concurrent.ThreadPoolExecutor@72fedac3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:34,292 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): master:41793-0x1006371ada30000, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:34,292 ERROR [Listener at localhost/46577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7abafe9d rejected from java.util.concurrent.ThreadPoolExecutor@72fedac3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:34,391 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:34,391 INFO [RS:0;jenkins-hbase4:45097] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45097,1676656887407; zookeeper connection closed. 2023-02-17 18:01:34,391 ERROR [Listener at localhost/46577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@687e2f4b rejected from java.util.concurrent.ThreadPoolExecutor@171c8cb3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:34,391 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@58f79291] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@58f79291 2023-02-17 18:01:34,391 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:45097-0x1006371ada30001, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:34,391 ERROR [Listener at localhost/46577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@108c42fe rejected from java.util.concurrent.ThreadPoolExecutor@171c8cb3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:34,491 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:34,491 INFO [RS:1;jenkins-hbase4:33675] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33675,1676656887473; zookeeper connection closed. 2023-02-17 18:01:34,491 ERROR [Listener at localhost/46577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78e830bf rejected from java.util.concurrent.ThreadPoolExecutor@31918d29[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:34,492 DEBUG [Listener at localhost/46577-EventThread] zookeeper.ZKWatcher(600): regionserver:33675-0x1006371ada30002, quorum=127.0.0.1:53935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:34,492 ERROR [Listener at localhost/46577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@77970e93 rejected from java.util.concurrent.ThreadPoolExecutor@31918d29[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:34,493 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6359bce4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6359bce4 2023-02-17 18:01:34,493 INFO [Listener at localhost/46577] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 18:01:34,582 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/hadoop-4159637460952531149.jar 2023-02-17 18:01:34,586 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676656890825 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:34,586 DEBUG [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:34,587 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(239): region to add: 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=885fbc7cabc4d807b5ea46913a08630f as 885fbc7cabc4d807b5ea46913a08630f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=a29b3043c1bf8fa8ceeba0cbadad77cf as a29b3043c1bf8fa8ceeba0cbadad77cf in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=0edc1fa6cb68190eb80dfc8ab71e97c6 as 0edc1fa6cb68190eb80dfc8ab71e97c6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=f883c8755c55162e5bdc1460cc22b78f as f883c8755c55162e5bdc1460cc22b78f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=ff371276b52a00a0329f31e5039e1f0f as ff371276b52a00a0329f31e5039e1f0f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=4296cab86e8af48c221caaf0e166a525 as 4296cab86e8af48c221caaf0e166a525 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=cb2d88a813a8a16986e91c86c7019b6b as cb2d88a813a8a16986e91c86c7019b6b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=de34f4ac261ab451cc08d3d164d0d552 as de34f4ac261ab451cc08d3d164d0d552 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=9aa47450c18159eb010cbd44a0b38896 as 9aa47450c18159eb010cbd44a0b38896 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,588 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(585): clone region=438412d7b22fbc75872a98e8c3225e9a as 438412d7b22fbc75872a98e8c3225e9a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-17 18:01:34,589 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 885fbc7cabc4d807b5ea46913a08630f, NAME => 'testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,589 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => cb2d88a813a8a16986e91c86c7019b6b, NAME => 'testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,590 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ff371276b52a00a0329f31e5039e1f0f, NAME => 'testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,590 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => f883c8755c55162e5bdc1460cc22b78f, NAME => 'testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,590 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0edc1fa6cb68190eb80dfc8ab71e97c6, NAME => 'testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,591 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => a29b3043c1bf8fa8ceeba0cbadad77cf, NAME => 'testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,591 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => de34f4ac261ab451cc08d3d164d0d552, NAME => 'testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,591 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 4296cab86e8af48c221caaf0e166a525, NAME => 'testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,618 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,619 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8b2d34f4489f46cb878e3aac8b639d41 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,627 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,627 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,627 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8bf4537c633f48d5b5f3b75ad9b11fb6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,627 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 33bb5cad7b50441c80f0c6c7bb3350a8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,629 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,630 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 73b50499e91d42399c8650bbb1025724 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,630 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,630 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing cb2d88a813a8a16986e91c86c7019b6b, disabling compactions & flushes 2023-02-17 18:01:34,630 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:34,630 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:34,630 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. after waiting 0 ms 2023-02-17 18:01:34,631 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:34,631 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:34,631 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for cb2d88a813a8a16986e91c86c7019b6b: 2023-02-17 18:01:34,631 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bb7487bbd3db4e069b5a59d19baeaee2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,631 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 9aa47450c18159eb010cbd44a0b38896, NAME => 'testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,631 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1fb02151987141bb9c7690cca6700fad from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,632 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,632 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d601829b0dc74d1e92e6d4ee6c9c8c5c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,633 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,633 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a0647340668b4dadae9c3e23322b77b3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,633 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 663b3663802c4203826a1721f452d7bd from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,633 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,634 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing de34f4ac261ab451cc08d3d164d0d552, disabling compactions & flushes 2023-02-17 18:01:34,634 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:34,634 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:34,634 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. after waiting 0 ms 2023-02-17 18:01:34,634 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:34,634 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:34,634 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for de34f4ac261ab451cc08d3d164d0d552: 2023-02-17 18:01:34,634 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 438412d7b22fbc75872a98e8c3225e9a, NAME => 'testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,635 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing f883c8755c55162e5bdc1460cc22b78f, disabling compactions & flushes 2023-02-17 18:01:34,635 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:34,635 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:34,635 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. after waiting 0 ms 2023-02-17 18:01:34,635 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:34,635 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:34,635 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for f883c8755c55162e5bdc1460cc22b78f: 2023-02-17 18:01:34,636 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 450220f492cc4343bdde81532c931255 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 885fbc7cabc4d807b5ea46913a08630f, disabling compactions & flushes 2023-02-17 18:01:34,636 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:34,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:34,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. after waiting 0 ms 2023-02-17 18:01:34,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:34,636 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:34,636 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 885fbc7cabc4d807b5ea46913a08630f: 2023-02-17 18:01:34,637 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9e33f1c3e5f64b969882fd57e896ee01 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,640 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 4296cab86e8af48c221caaf0e166a525, disabling compactions & flushes 2023-02-17 18:01:34,640 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:34,640 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:34,640 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. after waiting 0 ms 2023-02-17 18:01:34,640 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:34,640 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:34,640 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 4296cab86e8af48c221caaf0e166a525: 2023-02-17 18:01:34,641 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 934df325a60847e489b3216d71652423 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing a29b3043c1bf8fa8ceeba0cbadad77cf, disabling compactions & flushes 2023-02-17 18:01:34,642 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 0edc1fa6cb68190eb80dfc8ab71e97c6, disabling compactions & flushes 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:34,642 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. after waiting 0 ms 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:34,642 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. after waiting 0 ms 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for a29b3043c1bf8fa8ceeba0cbadad77cf: 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:34,642 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:34,642 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 0edc1fa6cb68190eb80dfc8ab71e97c6: 2023-02-17 18:01:34,643 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ff371276b52a00a0329f31e5039e1f0f, disabling compactions & flushes 2023-02-17 18:01:34,643 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:34,643 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:34,643 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. after waiting 0 ms 2023-02-17 18:01:34,643 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:34,643 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:34,643 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ff371276b52a00a0329f31e5039e1f0f: 2023-02-17 18:01:34,648 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,648 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9c2cf064dcb94442a91e9a98401ea08d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,650 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:34,650 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 622c2f37556a44148a7f93908bd9430d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,651 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2ba98dafd3894d3e84bf11bcb4815147 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,653 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3317e8d21b46485e8d083147332a7b06 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-17 18:01:34,654 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 9aa47450c18159eb010cbd44a0b38896, disabling compactions & flushes 2023-02-17 18:01:34,654 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:34,654 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:34,654 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. after waiting 0 ms 2023-02-17 18:01:34,654 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:34,654 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:34,654 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 9aa47450c18159eb010cbd44a0b38896: 2023-02-17 18:01:34,656 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 438412d7b22fbc75872a98e8c3225e9a, disabling compactions & flushes 2023-02-17 18:01:34,656 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:34,656 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:34,656 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. after waiting 0 ms 2023-02-17 18:01:34,656 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:34,656 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:34,656 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 438412d7b22fbc75872a98e8c3225e9a: 2023-02-17 18:01:34,657 INFO [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676656890825 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:34,657 DEBUG [Listener at localhost/46577] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,657 DEBUG [Listener at localhost/46577] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c 2023-02-17 18:01:34,658 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-data/ 2023-02-17 18:01:34,659 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----default/ 2023-02-17 18:01:34,660 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-17 18:01:34,661 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------0edc1fa6cb68190eb80dfc8ab71e97c6/ 2023-02-17 18:01:34,661 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,661 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:34,666 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=0edc1fa6cb68190eb80dfc8ab71e97c6-73b50499e91d42399c8650bbb1025724 2023-02-17 18:01:34,666 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:34,667 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=0edc1fa6cb68190eb80dfc8ab71e97c6-450220f492cc4343bdde81532c931255 2023-02-17 18:01:34,667 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------4296cab86e8af48c221caaf0e166a525/ 2023-02-17 18:01:34,667 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,667 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:34,668 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=4296cab86e8af48c221caaf0e166a525-8bf4537c633f48d5b5f3b75ad9b11fb6 2023-02-17 18:01:34,668 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:34,668 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=4296cab86e8af48c221caaf0e166a525-663b3663802c4203826a1721f452d7bd 2023-02-17 18:01:34,669 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------438412d7b22fbc75872a98e8c3225e9a/ 2023-02-17 18:01:34,670 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,670 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:34,670 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=438412d7b22fbc75872a98e8c3225e9a-622c2f37556a44148a7f93908bd9430d 2023-02-17 18:01:34,670 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:34,671 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=438412d7b22fbc75872a98e8c3225e9a-3317e8d21b46485e8d083147332a7b06 2023-02-17 18:01:34,671 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------885fbc7cabc4d807b5ea46913a08630f/ 2023-02-17 18:01:34,672 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,672 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:34,674 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=885fbc7cabc4d807b5ea46913a08630f-8b2d34f4489f46cb878e3aac8b639d41 2023-02-17 18:01:34,674 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:34,674 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=885fbc7cabc4d807b5ea46913a08630f-bb7487bbd3db4e069b5a59d19baeaee2 2023-02-17 18:01:34,674 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------9aa47450c18159eb010cbd44a0b38896/ 2023-02-17 18:01:34,675 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,675 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:34,676 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=9aa47450c18159eb010cbd44a0b38896-9c2cf064dcb94442a91e9a98401ea08d 2023-02-17 18:01:34,676 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:34,677 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=9aa47450c18159eb010cbd44a0b38896-2ba98dafd3894d3e84bf11bcb4815147 2023-02-17 18:01:34,677 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------a29b3043c1bf8fa8ceeba0cbadad77cf/ 2023-02-17 18:01:34,678 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,678 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:34,679 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=a29b3043c1bf8fa8ceeba0cbadad77cf-d601829b0dc74d1e92e6d4ee6c9c8c5c 2023-02-17 18:01:34,679 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:34,679 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=a29b3043c1bf8fa8ceeba0cbadad77cf-9e33f1c3e5f64b969882fd57e896ee01 2023-02-17 18:01:34,679 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------cb2d88a813a8a16986e91c86c7019b6b/ 2023-02-17 18:01:34,680 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,680 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------de34f4ac261ab451cc08d3d164d0d552/ 2023-02-17 18:01:34,681 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,681 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------f883c8755c55162e5bdc1460cc22b78f/ 2023-02-17 18:01:34,682 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,682 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:34,683 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=f883c8755c55162e5bdc1460cc22b78f-33bb5cad7b50441c80f0c6c7bb3350a8 2023-02-17 18:01:34,683 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:34,683 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=f883c8755c55162e5bdc1460cc22b78f-1fb02151987141bb9c7690cca6700fad 2023-02-17 18:01:34,683 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |----------ff371276b52a00a0329f31e5039e1f0f/ 2023-02-17 18:01:34,684 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:34,684 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:34,685 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=ff371276b52a00a0329f31e5039e1f0f-a0647340668b4dadae9c3e23322b77b3 2023-02-17 18:01:34,685 DEBUG [Listener at localhost/46577] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:34,685 DEBUG [Listener at localhost/46577] util.CommonFSUtils(702): |----------------testWithMapReduce=ff371276b52a00a0329f31e5039e1f0f-934df325a60847e489b3216d71652423 2023-02-17 18:01:34,686 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,686 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,687 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,688 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,688 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,689 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,689 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,757 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/hadoop-6175262521494464265.jar 2023-02-17 18:01:34,757 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,758 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,758 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,758 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,759 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,759 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,759 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-17 18:01:34,760 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-17 18:01:34,760 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-17 18:01:34,761 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-17 18:01:34,761 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-17 18:01:34,761 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-17 18:01:34,762 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-17 18:01:34,762 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-17 18:01:34,762 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-17 18:01:34,763 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-17 18:01:34,763 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 18:01:34,763 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 18:01:34,764 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 18:01:34,764 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 18:01:34,765 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 18:01:34,853 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/hadoop-200200550455426146.jar 2023-02-17 18:01:34,854 DEBUG [Listener at localhost/46577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 18:01:34,861 WARN [Listener at localhost/46577] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-17 18:01:34,902 INFO [Listener at localhost/46577] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 18:01:35,072 WARN [Listener at localhost/46577] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/mapreduce.cluster.local.dir/1676656895011/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-17 18:01:35,073 WARN [Listener at localhost/46577] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/mapreduce.cluster.local.dir/1676656895011/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-17 18:01:35,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,125 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,131 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,136 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:35,138 DEBUG [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1 2023-02-17 18:01:35,138 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0edc1fa6cb68190eb80dfc8ab71e97c6 columnFamilyName f1 2023-02-17 18:01:35,145 DEBUG [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f1/testWithMapReduce=0edc1fa6cb68190eb80dfc8ab71e97c6-73b50499e91d42399c8650bbb1025724 2023-02-17 18:01:35,145 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(310): Store=0edc1fa6cb68190eb80dfc8ab71e97c6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,145 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0edc1fa6cb68190eb80dfc8ab71e97c6 2023-02-17 18:01:35,146 DEBUG [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2 2023-02-17 18:01:35,147 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0edc1fa6cb68190eb80dfc8ab71e97c6 columnFamilyName f2 2023-02-17 18:01:35,152 DEBUG [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/0edc1fa6cb68190eb80dfc8ab71e97c6/f2/testWithMapReduce=0edc1fa6cb68190eb80dfc8ab71e97c6-450220f492cc4343bdde81532c931255 2023-02-17 18:01:35,152 INFO [StoreOpener-0edc1fa6cb68190eb80dfc8ab71e97c6-1] regionserver.HStore(310): Store=0edc1fa6cb68190eb80dfc8ab71e97c6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,153 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,153 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0edc1fa6cb68190eb80dfc8ab71e97c6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63724731, jitterRate=-0.05042751133441925}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,153 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0edc1fa6cb68190eb80dfc8ab71e97c6: 2023-02-17 18:01:35,189 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0edc1fa6cb68190eb80dfc8ab71e97c6, disabling compactions & flushes 2023-02-17 18:01:35,189 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:35,189 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:35,189 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. after waiting 0 ms 2023-02-17 18:01:35,189 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:35,192 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676656889488.0edc1fa6cb68190eb80dfc8ab71e97c6. 2023-02-17 18:01:35,192 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0edc1fa6cb68190eb80dfc8ab71e97c6: 2023-02-17 18:01:35,196 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,196 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,199 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,205 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:35,206 DEBUG [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1 2023-02-17 18:01:35,207 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a29b3043c1bf8fa8ceeba0cbadad77cf columnFamilyName f1 2023-02-17 18:01:35,212 DEBUG [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f1/testWithMapReduce=a29b3043c1bf8fa8ceeba0cbadad77cf-d601829b0dc74d1e92e6d4ee6c9c8c5c 2023-02-17 18:01:35,212 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(310): Store=a29b3043c1bf8fa8ceeba0cbadad77cf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,212 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a29b3043c1bf8fa8ceeba0cbadad77cf 2023-02-17 18:01:35,213 DEBUG [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2 2023-02-17 18:01:35,214 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a29b3043c1bf8fa8ceeba0cbadad77cf columnFamilyName f2 2023-02-17 18:01:35,220 DEBUG [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/a29b3043c1bf8fa8ceeba0cbadad77cf/f2/testWithMapReduce=a29b3043c1bf8fa8ceeba0cbadad77cf-9e33f1c3e5f64b969882fd57e896ee01 2023-02-17 18:01:35,220 INFO [StoreOpener-a29b3043c1bf8fa8ceeba0cbadad77cf-1] regionserver.HStore(310): Store=a29b3043c1bf8fa8ceeba0cbadad77cf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,220 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,220 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a29b3043c1bf8fa8ceeba0cbadad77cf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69421744, jitterRate=0.03446459770202637}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a29b3043c1bf8fa8ceeba0cbadad77cf: 2023-02-17 18:01:35,249 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a29b3043c1bf8fa8ceeba0cbadad77cf, disabling compactions & flushes 2023-02-17 18:01:35,250 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:35,250 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:35,250 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. after waiting 0 ms 2023-02-17 18:01:35,250 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:35,250 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676656889488.a29b3043c1bf8fa8ceeba0cbadad77cf. 2023-02-17 18:01:35,251 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a29b3043c1bf8fa8ceeba0cbadad77cf: 2023-02-17 18:01:35,254 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,254 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,257 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,259 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:35,260 DEBUG [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1 2023-02-17 18:01:35,260 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 885fbc7cabc4d807b5ea46913a08630f columnFamilyName f1 2023-02-17 18:01:35,265 DEBUG [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f1/testWithMapReduce=885fbc7cabc4d807b5ea46913a08630f-8b2d34f4489f46cb878e3aac8b639d41 2023-02-17 18:01:35,265 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(310): Store=885fbc7cabc4d807b5ea46913a08630f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,265 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 885fbc7cabc4d807b5ea46913a08630f 2023-02-17 18:01:35,266 DEBUG [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2 2023-02-17 18:01:35,266 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 885fbc7cabc4d807b5ea46913a08630f columnFamilyName f2 2023-02-17 18:01:35,273 DEBUG [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/885fbc7cabc4d807b5ea46913a08630f/f2/testWithMapReduce=885fbc7cabc4d807b5ea46913a08630f-bb7487bbd3db4e069b5a59d19baeaee2 2023-02-17 18:01:35,273 INFO [StoreOpener-885fbc7cabc4d807b5ea46913a08630f-1] regionserver.HStore(310): Store=885fbc7cabc4d807b5ea46913a08630f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,273 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 885fbc7cabc4d807b5ea46913a08630f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71360398, jitterRate=0.0633527934551239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,273 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 885fbc7cabc4d807b5ea46913a08630f: 2023-02-17 18:01:35,315 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 885fbc7cabc4d807b5ea46913a08630f, disabling compactions & flushes 2023-02-17 18:01:35,315 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:35,315 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:35,315 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. after waiting 0 ms 2023-02-17 18:01:35,315 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:35,318 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676656889488.885fbc7cabc4d807b5ea46913a08630f. 2023-02-17 18:01:35,318 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 885fbc7cabc4d807b5ea46913a08630f: 2023-02-17 18:01:35,322 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,322 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,324 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,326 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:35,328 DEBUG [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b/f1 2023-02-17 18:01:35,328 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb2d88a813a8a16986e91c86c7019b6b columnFamilyName f1 2023-02-17 18:01:35,329 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] regionserver.HStore(310): Store=cb2d88a813a8a16986e91c86c7019b6b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,329 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb2d88a813a8a16986e91c86c7019b6b 2023-02-17 18:01:35,330 DEBUG [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/cb2d88a813a8a16986e91c86c7019b6b/f2 2023-02-17 18:01:35,330 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb2d88a813a8a16986e91c86c7019b6b columnFamilyName f2 2023-02-17 18:01:35,331 INFO [StoreOpener-cb2d88a813a8a16986e91c86c7019b6b-1] regionserver.HStore(310): Store=cb2d88a813a8a16986e91c86c7019b6b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,331 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cb2d88a813a8a16986e91c86c7019b6b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75094984, jitterRate=0.11900246143341064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,331 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cb2d88a813a8a16986e91c86c7019b6b: 2023-02-17 18:01:35,348 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cb2d88a813a8a16986e91c86c7019b6b, disabling compactions & flushes 2023-02-17 18:01:35,348 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:35,348 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:35,348 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. after waiting 0 ms 2023-02-17 18:01:35,348 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:35,348 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656889488.cb2d88a813a8a16986e91c86c7019b6b. 2023-02-17 18:01:35,348 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cb2d88a813a8a16986e91c86c7019b6b: 2023-02-17 18:01:35,352 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,352 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,354 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,356 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:35,356 DEBUG [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1 2023-02-17 18:01:35,357 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f883c8755c55162e5bdc1460cc22b78f columnFamilyName f1 2023-02-17 18:01:35,361 DEBUG [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f1/testWithMapReduce=f883c8755c55162e5bdc1460cc22b78f-33bb5cad7b50441c80f0c6c7bb3350a8 2023-02-17 18:01:35,361 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(310): Store=f883c8755c55162e5bdc1460cc22b78f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,361 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f883c8755c55162e5bdc1460cc22b78f 2023-02-17 18:01:35,362 DEBUG [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2 2023-02-17 18:01:35,362 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f883c8755c55162e5bdc1460cc22b78f columnFamilyName f2 2023-02-17 18:01:35,366 DEBUG [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/f883c8755c55162e5bdc1460cc22b78f/f2/testWithMapReduce=f883c8755c55162e5bdc1460cc22b78f-1fb02151987141bb9c7690cca6700fad 2023-02-17 18:01:35,366 INFO [StoreOpener-f883c8755c55162e5bdc1460cc22b78f-1] regionserver.HStore(310): Store=f883c8755c55162e5bdc1460cc22b78f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,367 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,367 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f883c8755c55162e5bdc1460cc22b78f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74826211, jitterRate=0.11499743163585663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,367 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f883c8755c55162e5bdc1460cc22b78f: 2023-02-17 18:01:35,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f883c8755c55162e5bdc1460cc22b78f, disabling compactions & flushes 2023-02-17 18:01:35,394 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:35,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:35,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. after waiting 0 ms 2023-02-17 18:01:35,394 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:35,395 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676656889488.f883c8755c55162e5bdc1460cc22b78f. 2023-02-17 18:01:35,396 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f883c8755c55162e5bdc1460cc22b78f: 2023-02-17 18:01:35,400 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,400 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,402 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,403 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:35,404 DEBUG [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1 2023-02-17 18:01:35,404 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aa47450c18159eb010cbd44a0b38896 columnFamilyName f1 2023-02-17 18:01:35,408 DEBUG [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f1/testWithMapReduce=9aa47450c18159eb010cbd44a0b38896-9c2cf064dcb94442a91e9a98401ea08d 2023-02-17 18:01:35,409 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(310): Store=9aa47450c18159eb010cbd44a0b38896/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,409 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9aa47450c18159eb010cbd44a0b38896 2023-02-17 18:01:35,410 DEBUG [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2 2023-02-17 18:01:35,410 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aa47450c18159eb010cbd44a0b38896 columnFamilyName f2 2023-02-17 18:01:35,414 DEBUG [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/9aa47450c18159eb010cbd44a0b38896/f2/testWithMapReduce=9aa47450c18159eb010cbd44a0b38896-2ba98dafd3894d3e84bf11bcb4815147 2023-02-17 18:01:35,414 INFO [StoreOpener-9aa47450c18159eb010cbd44a0b38896-1] regionserver.HStore(310): Store=9aa47450c18159eb010cbd44a0b38896/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,414 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,415 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9aa47450c18159eb010cbd44a0b38896; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72484568, jitterRate=0.08010423183441162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,415 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9aa47450c18159eb010cbd44a0b38896: 2023-02-17 18:01:35,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9aa47450c18159eb010cbd44a0b38896, disabling compactions & flushes 2023-02-17 18:01:35,454 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:35,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:35,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. after waiting 0 ms 2023-02-17 18:01:35,454 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:35,454 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676656889488.9aa47450c18159eb010cbd44a0b38896. 2023-02-17 18:01:35,455 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9aa47450c18159eb010cbd44a0b38896: 2023-02-17 18:01:35,458 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,458 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,459 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,460 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:35,462 DEBUG [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552/f1 2023-02-17 18:01:35,462 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de34f4ac261ab451cc08d3d164d0d552 columnFamilyName f1 2023-02-17 18:01:35,463 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] regionserver.HStore(310): Store=de34f4ac261ab451cc08d3d164d0d552/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,463 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de34f4ac261ab451cc08d3d164d0d552 2023-02-17 18:01:35,464 DEBUG [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/de34f4ac261ab451cc08d3d164d0d552/f2 2023-02-17 18:01:35,464 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de34f4ac261ab451cc08d3d164d0d552 columnFamilyName f2 2023-02-17 18:01:35,465 INFO [StoreOpener-de34f4ac261ab451cc08d3d164d0d552-1] regionserver.HStore(310): Store=de34f4ac261ab451cc08d3d164d0d552/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,465 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened de34f4ac261ab451cc08d3d164d0d552; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70824944, jitterRate=0.0553739070892334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for de34f4ac261ab451cc08d3d164d0d552: 2023-02-17 18:01:35,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing de34f4ac261ab451cc08d3d164d0d552, disabling compactions & flushes 2023-02-17 18:01:35,490 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:35,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:35,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. after waiting 0 ms 2023-02-17 18:01:35,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:35,490 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676656889488.de34f4ac261ab451cc08d3d164d0d552. 2023-02-17 18:01:35,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for de34f4ac261ab451cc08d3d164d0d552: 2023-02-17 18:01:35,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,493 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,494 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,496 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:35,498 DEBUG [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1 2023-02-17 18:01:35,498 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4296cab86e8af48c221caaf0e166a525 columnFamilyName f1 2023-02-17 18:01:35,503 DEBUG [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f1/testWithMapReduce=4296cab86e8af48c221caaf0e166a525-8bf4537c633f48d5b5f3b75ad9b11fb6 2023-02-17 18:01:35,503 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(310): Store=4296cab86e8af48c221caaf0e166a525/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,504 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4296cab86e8af48c221caaf0e166a525 2023-02-17 18:01:35,505 DEBUG [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2 2023-02-17 18:01:35,505 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4296cab86e8af48c221caaf0e166a525 columnFamilyName f2 2023-02-17 18:01:35,510 DEBUG [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/4296cab86e8af48c221caaf0e166a525/f2/testWithMapReduce=4296cab86e8af48c221caaf0e166a525-663b3663802c4203826a1721f452d7bd 2023-02-17 18:01:35,510 INFO [StoreOpener-4296cab86e8af48c221caaf0e166a525-1] regionserver.HStore(310): Store=4296cab86e8af48c221caaf0e166a525/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,510 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4296cab86e8af48c221caaf0e166a525; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61405918, jitterRate=-0.08498051762580872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,510 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4296cab86e8af48c221caaf0e166a525: 2023-02-17 18:01:35,538 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4296cab86e8af48c221caaf0e166a525, disabling compactions & flushes 2023-02-17 18:01:35,539 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:35,539 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:35,539 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. after waiting 0 ms 2023-02-17 18:01:35,539 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:35,540 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676656889488.4296cab86e8af48c221caaf0e166a525. 2023-02-17 18:01:35,540 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4296cab86e8af48c221caaf0e166a525: 2023-02-17 18:01:35,543 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,543 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,545 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,546 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:35,547 DEBUG [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1 2023-02-17 18:01:35,547 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff371276b52a00a0329f31e5039e1f0f columnFamilyName f1 2023-02-17 18:01:35,553 DEBUG [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f1/testWithMapReduce=ff371276b52a00a0329f31e5039e1f0f-a0647340668b4dadae9c3e23322b77b3 2023-02-17 18:01:35,553 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(310): Store=ff371276b52a00a0329f31e5039e1f0f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,553 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ff371276b52a00a0329f31e5039e1f0f 2023-02-17 18:01:35,554 DEBUG [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2 2023-02-17 18:01:35,554 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff371276b52a00a0329f31e5039e1f0f columnFamilyName f2 2023-02-17 18:01:35,559 DEBUG [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/ff371276b52a00a0329f31e5039e1f0f/f2/testWithMapReduce=ff371276b52a00a0329f31e5039e1f0f-934df325a60847e489b3216d71652423 2023-02-17 18:01:35,559 INFO [StoreOpener-ff371276b52a00a0329f31e5039e1f0f-1] regionserver.HStore(310): Store=ff371276b52a00a0329f31e5039e1f0f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,559 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,559 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ff371276b52a00a0329f31e5039e1f0f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72280468, jitterRate=0.07706290483474731}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,560 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ff371276b52a00a0329f31e5039e1f0f: 2023-02-17 18:01:35,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ff371276b52a00a0329f31e5039e1f0f, disabling compactions & flushes 2023-02-17 18:01:35,587 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:35,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:35,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. after waiting 0 ms 2023-02-17 18:01:35,587 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:35,588 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676656889488.ff371276b52a00a0329f31e5039e1f0f. 2023-02-17 18:01:35,588 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ff371276b52a00a0329f31e5039e1f0f: 2023-02-17 18:01:35,590 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:35,590 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:35,592 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:35,594 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:35,595 DEBUG [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1 2023-02-17 18:01:35,595 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 438412d7b22fbc75872a98e8c3225e9a columnFamilyName f1 2023-02-17 18:01:35,600 DEBUG [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f1/testWithMapReduce=438412d7b22fbc75872a98e8c3225e9a-622c2f37556a44148a7f93908bd9430d 2023-02-17 18:01:35,600 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(310): Store=438412d7b22fbc75872a98e8c3225e9a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,600 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 438412d7b22fbc75872a98e8c3225e9a 2023-02-17 18:01:35,601 DEBUG [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2 2023-02-17 18:01:35,601 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 438412d7b22fbc75872a98e8c3225e9a columnFamilyName f2 2023-02-17 18:01:35,605 DEBUG [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(539): loaded hdfs://localhost:44339/user/jenkins/test-data/51b6641a-a593-a48f-e082-26eccd22d0bb/testWithMapReduceAndOfflineHBaseMultiRegion/447a0956-1c65-4bad-aedb-b9aeee26014c/data/default/testWithMapReduce/438412d7b22fbc75872a98e8c3225e9a/f2/testWithMapReduce=438412d7b22fbc75872a98e8c3225e9a-3317e8d21b46485e8d083147332a7b06 2023-02-17 18:01:35,605 INFO [StoreOpener-438412d7b22fbc75872a98e8c3225e9a-1] regionserver.HStore(310): Store=438412d7b22fbc75872a98e8c3225e9a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:35,605 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:35,606 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 438412d7b22fbc75872a98e8c3225e9a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73288108, jitterRate=0.09207791090011597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:35,606 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 438412d7b22fbc75872a98e8c3225e9a: 2023-02-17 18:01:35,634 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 438412d7b22fbc75872a98e8c3225e9a, disabling compactions & flushes 2023-02-17 18:01:35,634 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:35,634 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:35,634 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. after waiting 0 ms 2023-02-17 18:01:35,634 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:35,635 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676656889488.438412d7b22fbc75872a98e8c3225e9a. 2023-02-17 18:01:35,635 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 438412d7b22fbc75872a98e8c3225e9a: 2023-02-17 18:01:36,125 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 18:01:36,125 WARN [Listener at localhost/46577] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:36,129 INFO [Listener at localhost/46577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:36,240 WARN [BP-73716319-172.31.14.131-1676656883836 heartbeating to localhost/127.0.0.1:44339] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:36,240 WARN [BP-73716319-172.31.14.131-1676656883836 heartbeating to localhost/127.0.0.1:44339] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-73716319-172.31.14.131-1676656883836 (Datanode Uuid 73a6b2d4-aec2-4676-b551-3db8b321a67e) service to localhost/127.0.0.1:44339 2023-02-17 18:01:36,241 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/cluster_62669028-177d-b01f-f5dc-19c98b18f939/dfs/data/data3/current/BP-73716319-172.31.14.131-1676656883836] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:36,241 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/cluster_62669028-177d-b01f-f5dc-19c98b18f939/dfs/data/data4/current/BP-73716319-172.31.14.131-1676656883836] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:36,243 WARN [Listener at localhost/46577] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:36,250 INFO [Listener at localhost/46577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:36,353 WARN [BP-73716319-172.31.14.131-1676656883836 heartbeating to localhost/127.0.0.1:44339] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:36,353 WARN [BP-73716319-172.31.14.131-1676656883836 heartbeating to localhost/127.0.0.1:44339] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-73716319-172.31.14.131-1676656883836 (Datanode Uuid f555f647-d688-47b6-9b35-00e6b94c555b) service to localhost/127.0.0.1:44339 2023-02-17 18:01:36,354 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/cluster_62669028-177d-b01f-f5dc-19c98b18f939/dfs/data/data1/current/BP-73716319-172.31.14.131-1676656883836] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:36,354 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/cluster_62669028-177d-b01f-f5dc-19c98b18f939/dfs/data/data2/current/BP-73716319-172.31.14.131-1676656883836] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:36,363 INFO [Listener at localhost/46577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:36,493 INFO [Listener at localhost/46577] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 18:01:36,551 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 18:01:36,563 INFO [Listener at localhost/46577] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 104) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:44339 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:44339 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:44339 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:44339 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41793,1676656886771)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:44339 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:44339 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44339 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46577 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=531 (was 535), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=419 (was 361) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=7308 (was 7861) 2023-02-17 18:01:36,574 INFO [Listener at localhost/46577] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=531, MaxFileDescriptor=60000, SystemLoadAverage=419, ProcessCount=171, AvailableMemoryMB=7308 2023-02-17 18:01:36,584 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/hadoop.log.dir so I do NOT create it in target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383 2023-02-17 18:01:36,584 WARN [Listener at localhost/46577] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 18:01:36,584 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/hadoop.tmp.dir so I do NOT create it in target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383 2023-02-17 18:01:36,584 WARN [Listener at localhost/46577] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d947baf-a405-fb9e-d39b-c5dc1d009097/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 18:01:36,584 DEBUG [Listener at localhost/46577] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383 2023-02-17 18:01:36,584 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 18:01:36,584 INFO [Listener at localhost/46577] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/cluster_d07f2f11-b29e-60ad-6d52-2d21d064e8a7, deleteOnExit=true 2023-02-17 18:01:36,584 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 18:01:36,584 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/test.cache.data in system properties and HBase conf 2023-02-17 18:01:36,585 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 18:01:36,585 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/hadoop.log.dir in system properties and HBase conf 2023-02-17 18:01:36,585 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 18:01:36,585 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 18:01:36,585 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 18:01:36,585 DEBUG [Listener at localhost/46577] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 18:01:36,585 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:36,585 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:36,585 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/nfs.dump.dir in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/java.io.tmpdir in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 18:01:36,586 INFO [Listener at localhost/46577] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 18:01:36,590 WARN [Listener at localhost/46577] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:36,591 WARN [Listener at localhost/46577] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:36,634 WARN [Listener at localhost/46577] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:36,637 INFO [Listener at localhost/46577] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:36,644 INFO [Listener at localhost/46577] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/java.io.tmpdir/Jetty_localhost_34417_hdfs____apabyb/webapp 2023-02-17 18:01:36,740 INFO [Listener at localhost/46577] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34417 2023-02-17 18:01:36,769 WARN [Listener at localhost/46577] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:36,769 WARN [Listener at localhost/46577] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:36,808 WARN [Listener at localhost/32807] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:36,818 WARN [Listener at localhost/32807] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:36,820 WARN [Listener at localhost/32807] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:36,821 INFO [Listener at localhost/32807] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:36,825 INFO [Listener at localhost/32807] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/java.io.tmpdir/Jetty_localhost_46851_datanode____.qs5r7r/webapp 2023-02-17 18:01:36,916 INFO [Listener at localhost/32807] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46851 2023-02-17 18:01:36,923 WARN [Listener at localhost/39899] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:36,938 WARN [Listener at localhost/39899] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:36,940 WARN [Listener at localhost/39899] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:36,941 INFO [Listener at localhost/39899] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:36,944 INFO [Listener at localhost/39899] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/java.io.tmpdir/Jetty_localhost_41215_datanode____lxrgyo/webapp 2023-02-17 18:01:37,023 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ee920d4a191fe11: Processing first storage report for DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2 from datanode 86921086-78b7-45d0-9182-9bf2af1b7b83 2023-02-17 18:01:37,024 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ee920d4a191fe11: from storage DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2 node DatanodeRegistration(127.0.0.1:33429, datanodeUuid=86921086-78b7-45d0-9182-9bf2af1b7b83, infoPort=44883, infoSecurePort=0, ipcPort=39899, storageInfo=lv=-57;cid=testClusterID;nsid=876322841;c=1676656896593), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-17 18:01:37,024 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1ee920d4a191fe11: Processing first storage report for DS-7246f751-6828-49e8-9b1e-bfe4c99452d4 from datanode 86921086-78b7-45d0-9182-9bf2af1b7b83 2023-02-17 18:01:37,024 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1ee920d4a191fe11: from storage DS-7246f751-6828-49e8-9b1e-bfe4c99452d4 node DatanodeRegistration(127.0.0.1:33429, datanodeUuid=86921086-78b7-45d0-9182-9bf2af1b7b83, infoPort=44883, infoSecurePort=0, ipcPort=39899, storageInfo=lv=-57;cid=testClusterID;nsid=876322841;c=1676656896593), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:37,051 INFO [Listener at localhost/39899] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41215 2023-02-17 18:01:37,058 WARN [Listener at localhost/33553] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:37,176 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcea2f221143cd47e: Processing first storage report for DS-f4a12c43-6e09-42b0-8b38-35954168394e from datanode a4a0aceb-edfb-4363-8655-0e89781daa25 2023-02-17 18:01:37,176 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcea2f221143cd47e: from storage DS-f4a12c43-6e09-42b0-8b38-35954168394e node DatanodeRegistration(127.0.0.1:43871, datanodeUuid=a4a0aceb-edfb-4363-8655-0e89781daa25, infoPort=39943, infoSecurePort=0, ipcPort=33553, storageInfo=lv=-57;cid=testClusterID;nsid=876322841;c=1676656896593), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:37,176 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcea2f221143cd47e: Processing first storage report for DS-98f91e72-ce74-47b6-9669-79a1b5a45b82 from datanode a4a0aceb-edfb-4363-8655-0e89781daa25 2023-02-17 18:01:37,177 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcea2f221143cd47e: from storage DS-98f91e72-ce74-47b6-9669-79a1b5a45b82 node DatanodeRegistration(127.0.0.1:43871, datanodeUuid=a4a0aceb-edfb-4363-8655-0e89781daa25, infoPort=39943, infoSecurePort=0, ipcPort=33553, storageInfo=lv=-57;cid=testClusterID;nsid=876322841;c=1676656896593), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:37,266 DEBUG [Listener at localhost/33553] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383 2023-02-17 18:01:37,268 INFO [Listener at localhost/33553] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/cluster_d07f2f11-b29e-60ad-6d52-2d21d064e8a7/zookeeper_0, clientPort=58388, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/cluster_d07f2f11-b29e-60ad-6d52-2d21d064e8a7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/cluster_d07f2f11-b29e-60ad-6d52-2d21d064e8a7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 18:01:37,269 INFO [Listener at localhost/33553] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58388 2023-02-17 18:01:37,269 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,270 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,281 INFO [Listener at localhost/33553] util.FSUtils(479): Created version file at hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640 with version=8 2023-02-17 18:01:37,281 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,282 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,283 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32807/user/jenkins/test-data/7ae6c726-627e-dc16-b35a-391d18db83d4/hbase-staging 2023-02-17 18:01:37,285 INFO [Listener at localhost/33553] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:37,285 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:37,285 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:37,285 INFO [Listener at localhost/33553] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:37,285 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:37,285 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:37,285 INFO [Listener at localhost/33553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:37,286 INFO [Listener at localhost/33553] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37103 2023-02-17 18:01:37,287 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,288 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,288 INFO [Listener at localhost/33553] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37103 connecting to ZooKeeper ensemble=127.0.0.1:58388 2023-02-17 18:01:37,297 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:371030x0, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:37,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37103-0x1006371d6b80000 connected 2023-02-17 18:01:37,327 DEBUG [Listener at localhost/33553] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:37,327 DEBUG [Listener at localhost/33553] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:37,328 DEBUG [Listener at localhost/33553] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:37,329 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37103 2023-02-17 18:01:37,333 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37103 2023-02-17 18:01:37,333 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37103 2023-02-17 18:01:37,334 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37103 2023-02-17 18:01:37,334 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37103 2023-02-17 18:01:37,334 INFO [Listener at localhost/33553] master.HMaster(444): hbase.rootdir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640, hbase.cluster.distributed=false 2023-02-17 18:01:37,349 INFO [Listener at localhost/33553] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:37,349 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:37,349 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:37,350 INFO [Listener at localhost/33553] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:37,350 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:37,350 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:37,350 INFO [Listener at localhost/33553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:37,352 INFO [Listener at localhost/33553] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36265 2023-02-17 18:01:37,353 INFO [Listener at localhost/33553] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:37,357 DEBUG [Listener at localhost/33553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:37,357 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,359 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,360 INFO [Listener at localhost/33553] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36265 connecting to ZooKeeper ensemble=127.0.0.1:58388 2023-02-17 18:01:37,367 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:362650x0, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:37,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36265-0x1006371d6b80001 connected 2023-02-17 18:01:37,369 DEBUG [Listener at localhost/33553] zookeeper.ZKUtil(164): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:37,370 DEBUG [Listener at localhost/33553] zookeeper.ZKUtil(164): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:37,371 DEBUG [Listener at localhost/33553] zookeeper.ZKUtil(164): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:37,375 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36265 2023-02-17 18:01:37,378 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36265 2023-02-17 18:01:37,386 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36265 2023-02-17 18:01:37,396 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36265 2023-02-17 18:01:37,398 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36265 2023-02-17 18:01:37,412 INFO [Listener at localhost/33553] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:37,412 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:37,412 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:37,412 INFO [Listener at localhost/33553] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:37,412 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:37,412 INFO [Listener at localhost/33553] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:37,412 INFO [Listener at localhost/33553] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:37,414 INFO [Listener at localhost/33553] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34575 2023-02-17 18:01:37,414 INFO [Listener at localhost/33553] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:37,415 DEBUG [Listener at localhost/33553] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:37,416 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,416 INFO [Listener at localhost/33553] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,417 INFO [Listener at localhost/33553] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34575 connecting to ZooKeeper ensemble=127.0.0.1:58388 2023-02-17 18:01:37,420 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:345750x0, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:37,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34575-0x1006371d6b80002 connected 2023-02-17 18:01:37,423 DEBUG [Listener at localhost/33553] zookeeper.ZKUtil(164): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:37,424 DEBUG [Listener at localhost/33553] zookeeper.ZKUtil(164): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:37,425 DEBUG [Listener at localhost/33553] zookeeper.ZKUtil(164): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:37,425 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34575 2023-02-17 18:01:37,425 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34575 2023-02-17 18:01:37,425 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34575 2023-02-17 18:01:37,426 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34575 2023-02-17 18:01:37,426 DEBUG [Listener at localhost/33553] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34575 2023-02-17 18:01:37,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:37,428 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:37,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:37,431 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:37,431 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:37,431 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:37,431 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:37,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:37,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37103,1676656897284 from backup master directory 2023-02-17 18:01:37,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:37,435 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:37,435 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:37,435 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:37,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:37,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/hbase.id with ID: ce26847a-b6a3-43fc-a7e4-22af3f850275 2023-02-17 18:01:37,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:37,459 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:37,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x76bf6441 to 127.0.0.1:58388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:37,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32b252a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:37,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:37,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 18:01:37,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:37,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/data/master/store-tmp 2023-02-17 18:01:37,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:37,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:37,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:37,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:37,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:37,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:37,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:37,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:37,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/WALs/jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:37,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37103%2C1676656897284, suffix=, logDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/WALs/jenkins-hbase4.apache.org,37103,1676656897284, archiveDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/oldWALs, maxLogs=10 2023-02-17 18:01:37,534 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43871,DS-f4a12c43-6e09-42b0-8b38-35954168394e,DISK] 2023-02-17 18:01:37,534 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33429,DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2,DISK] 2023-02-17 18:01:37,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/WALs/jenkins-hbase4.apache.org,37103,1676656897284/jenkins-hbase4.apache.org%2C37103%2C1676656897284.1676656897514 2023-02-17 18:01:37,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43871,DS-f4a12c43-6e09-42b0-8b38-35954168394e,DISK], DatanodeInfoWithStorage[127.0.0.1:33429,DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2,DISK]] 2023-02-17 18:01:37,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:37,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:37,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:37,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:37,539 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:37,540 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 18:01:37,540 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 18:01:37,541 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:37,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:37,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:37,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:37,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:37,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65309409, jitterRate=-0.026813969016075134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:37,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:37,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 18:01:37,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 18:01:37,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 18:01:37,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 18:01:37,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 18:01:37,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 18:01:37,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 18:01:37,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 18:01:37,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 18:01:37,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 18:01:37,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 18:01:37,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 18:01:37,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 18:01:37,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 18:01:37,568 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:37,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 18:01:37,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 18:01:37,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 18:01:37,571 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:37,571 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:37,571 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:37,571 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:37,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37103,1676656897284, sessionid=0x1006371d6b80000, setting cluster-up flag (Was=false) 2023-02-17 18:01:37,576 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:37,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 18:01:37,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:37,584 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:37,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 18:01:37,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:37,590 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.hbase-snapshot/.tmp 2023-02-17 18:01:37,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:37,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:37,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:37,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:37,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:37,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 18:01:37,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:37,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676656927595 2023-02-17 18:01:37,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 18:01:37,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 18:01:37,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 18:01:37,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 18:01:37,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 18:01:37,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 18:01:37,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,596 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:37,597 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 18:01:37,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 18:01:37,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 18:01:37,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 18:01:37,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 18:01:37,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 18:01:37,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656897597,5,FailOnTimeoutGroup] 2023-02-17 18:01:37,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656897598,5,FailOnTimeoutGroup] 2023-02-17 18:01:37,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 18:01:37,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,598 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:37,607 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:37,607 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:37,607 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640 2023-02-17 18:01:37,613 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:37,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:37,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/info 2023-02-17 18:01:37,616 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:37,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:37,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:37,618 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:37,618 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:37,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:37,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:37,620 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/table 2023-02-17 18:01:37,620 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:37,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:37,622 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740 2023-02-17 18:01:37,622 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740 2023-02-17 18:01:37,624 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:37,626 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:37,628 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:37,630 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69853762, jitterRate=0.040902167558670044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:37,630 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:37,630 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:37,630 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:37,630 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:37,630 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:37,630 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:37,630 INFO [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(952): ClusterId : ce26847a-b6a3-43fc-a7e4-22af3f850275 2023-02-17 18:01:37,631 DEBUG [RS:0;jenkins-hbase4:36265] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:37,631 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(952): ClusterId : ce26847a-b6a3-43fc-a7e4-22af3f850275 2023-02-17 18:01:37,631 DEBUG [RS:1;jenkins-hbase4:34575] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:37,631 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:37,631 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:37,632 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:37,632 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 18:01:37,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 18:01:37,637 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 18:01:37,637 DEBUG [RS:0;jenkins-hbase4:36265] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:37,637 DEBUG [RS:0;jenkins-hbase4:36265] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:37,641 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 18:01:37,641 DEBUG [RS:1;jenkins-hbase4:34575] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:37,641 DEBUG [RS:1;jenkins-hbase4:34575] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:37,641 DEBUG [RS:0;jenkins-hbase4:36265] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:37,642 DEBUG [RS:0;jenkins-hbase4:36265] zookeeper.ReadOnlyZKClient(139): Connect 0x7800aa02 to 127.0.0.1:58388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:37,645 DEBUG [RS:1;jenkins-hbase4:34575] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:37,646 DEBUG [RS:1;jenkins-hbase4:34575] zookeeper.ReadOnlyZKClient(139): Connect 0x1ace3f91 to 127.0.0.1:58388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:37,649 DEBUG [RS:0;jenkins-hbase4:36265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76c74b72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:37,649 DEBUG [RS:0;jenkins-hbase4:36265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72f8c172, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:37,657 DEBUG [RS:1;jenkins-hbase4:34575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1409d2b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:37,657 DEBUG [RS:1;jenkins-hbase4:34575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@103654e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:37,660 DEBUG [RS:0;jenkins-hbase4:36265] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36265 2023-02-17 18:01:37,660 INFO [RS:0;jenkins-hbase4:36265] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:37,661 INFO [RS:0;jenkins-hbase4:36265] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:37,661 DEBUG [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:37,661 INFO [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37103,1676656897284 with isa=jenkins-hbase4.apache.org/172.31.14.131:36265, startcode=1676656897348 2023-02-17 18:01:37,661 DEBUG [RS:0;jenkins-hbase4:36265] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:37,664 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42865, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:37,667 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:37,667 DEBUG [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640 2023-02-17 18:01:37,667 DEBUG [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32807 2023-02-17 18:01:37,667 DEBUG [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:37,668 DEBUG [RS:1;jenkins-hbase4:34575] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34575 2023-02-17 18:01:37,668 INFO [RS:1;jenkins-hbase4:34575] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:37,668 INFO [RS:1;jenkins-hbase4:34575] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:37,668 DEBUG [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:37,671 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:37,671 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37103,1676656897284 with isa=jenkins-hbase4.apache.org/172.31.14.131:34575, startcode=1676656897411 2023-02-17 18:01:37,671 DEBUG [RS:1;jenkins-hbase4:34575] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:37,672 DEBUG [RS:0;jenkins-hbase4:36265] zookeeper.ZKUtil(162): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:37,672 WARN [RS:0;jenkins-hbase4:36265] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:37,672 INFO [RS:0;jenkins-hbase4:36265] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:37,672 DEBUG [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/WALs/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:37,674 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36265,1676656897348] 2023-02-17 18:01:37,679 DEBUG [RS:0;jenkins-hbase4:36265] zookeeper.ZKUtil(162): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:37,680 DEBUG [RS:0;jenkins-hbase4:36265] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:37,680 INFO [RS:0;jenkins-hbase4:36265] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:37,684 INFO [RS:0;jenkins-hbase4:36265] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:37,684 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60727, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:37,684 INFO [RS:0;jenkins-hbase4:36265] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:37,684 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:37,684 INFO [RS:0;jenkins-hbase4:36265] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,685 DEBUG [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640 2023-02-17 18:01:37,685 DEBUG [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:32807 2023-02-17 18:01:37,685 DEBUG [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:37,689 INFO [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:37,697 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:37,697 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:37,698 DEBUG [RS:1;jenkins-hbase4:34575] zookeeper.ZKUtil(162): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:37,698 INFO [RS:0;jenkins-hbase4:36265] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,698 WARN [RS:1;jenkins-hbase4:34575] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:37,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:37,698 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34575,1676656897411] 2023-02-17 18:01:37,698 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,698 INFO [RS:1;jenkins-hbase4:34575] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:37,698 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,698 DEBUG [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1947): logDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/WALs/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:37,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:37,698 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,699 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,699 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,699 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:37,699 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,699 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,699 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,699 DEBUG [RS:0;jenkins-hbase4:36265] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,704 INFO [RS:0;jenkins-hbase4:36265] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,704 INFO [RS:0;jenkins-hbase4:36265] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,704 INFO [RS:0;jenkins-hbase4:36265] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,708 DEBUG [RS:1;jenkins-hbase4:34575] zookeeper.ZKUtil(162): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:37,709 DEBUG [RS:1;jenkins-hbase4:34575] zookeeper.ZKUtil(162): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:37,710 DEBUG [RS:1;jenkins-hbase4:34575] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:37,710 INFO [RS:1;jenkins-hbase4:34575] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:37,712 INFO [RS:1;jenkins-hbase4:34575] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:37,720 INFO [RS:0;jenkins-hbase4:36265] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:37,720 INFO [RS:1;jenkins-hbase4:34575] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:37,720 INFO [RS:0;jenkins-hbase4:36265] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36265,1676656897348-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,720 INFO [RS:1;jenkins-hbase4:34575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,721 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:37,722 INFO [RS:1;jenkins-hbase4:34575] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,723 DEBUG [RS:1;jenkins-hbase4:34575] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:37,729 INFO [RS:1;jenkins-hbase4:34575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,729 INFO [RS:1;jenkins-hbase4:34575] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,729 INFO [RS:1;jenkins-hbase4:34575] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,745 INFO [RS:0;jenkins-hbase4:36265] regionserver.Replication(203): jenkins-hbase4.apache.org,36265,1676656897348 started 2023-02-17 18:01:37,745 INFO [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36265,1676656897348, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36265, sessionid=0x1006371d6b80001 2023-02-17 18:01:37,746 DEBUG [RS:0;jenkins-hbase4:36265] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:37,746 DEBUG [RS:0;jenkins-hbase4:36265] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:37,746 DEBUG [RS:0;jenkins-hbase4:36265] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36265,1676656897348' 2023-02-17 18:01:37,746 DEBUG [RS:0;jenkins-hbase4:36265] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:37,746 DEBUG [RS:0;jenkins-hbase4:36265] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:37,747 DEBUG [RS:0;jenkins-hbase4:36265] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:37,747 DEBUG [RS:0;jenkins-hbase4:36265] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:37,747 DEBUG [RS:0;jenkins-hbase4:36265] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:37,747 DEBUG [RS:0;jenkins-hbase4:36265] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36265,1676656897348' 2023-02-17 18:01:37,747 DEBUG [RS:0;jenkins-hbase4:36265] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:37,747 DEBUG [RS:0;jenkins-hbase4:36265] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:37,747 INFO [RS:1;jenkins-hbase4:34575] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:37,748 DEBUG [RS:0;jenkins-hbase4:36265] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:37,748 INFO [RS:1;jenkins-hbase4:34575] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34575,1676656897411-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:37,748 INFO [RS:0;jenkins-hbase4:36265] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:37,748 INFO [RS:0;jenkins-hbase4:36265] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:37,776 INFO [RS:1;jenkins-hbase4:34575] regionserver.Replication(203): jenkins-hbase4.apache.org,34575,1676656897411 started 2023-02-17 18:01:37,776 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34575,1676656897411, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34575, sessionid=0x1006371d6b80002 2023-02-17 18:01:37,776 DEBUG [RS:1;jenkins-hbase4:34575] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:37,776 DEBUG [RS:1;jenkins-hbase4:34575] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:37,776 DEBUG [RS:1;jenkins-hbase4:34575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34575,1676656897411' 2023-02-17 18:01:37,776 DEBUG [RS:1;jenkins-hbase4:34575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:37,777 DEBUG [RS:1;jenkins-hbase4:34575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:37,777 DEBUG [RS:1;jenkins-hbase4:34575] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:37,777 DEBUG [RS:1;jenkins-hbase4:34575] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:37,777 DEBUG [RS:1;jenkins-hbase4:34575] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:37,777 DEBUG [RS:1;jenkins-hbase4:34575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34575,1676656897411' 2023-02-17 18:01:37,777 DEBUG [RS:1;jenkins-hbase4:34575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:37,778 DEBUG [RS:1;jenkins-hbase4:34575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:37,778 DEBUG [RS:1;jenkins-hbase4:34575] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:37,778 INFO [RS:1;jenkins-hbase4:34575] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:37,778 INFO [RS:1;jenkins-hbase4:34575] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:37,791 DEBUG [jenkins-hbase4:37103] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 18:01:37,791 DEBUG [jenkins-hbase4:37103] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:37,793 DEBUG [jenkins-hbase4:37103] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:37,793 DEBUG [jenkins-hbase4:37103] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:37,793 DEBUG [jenkins-hbase4:37103] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:37,794 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34575,1676656897411, state=OPENING 2023-02-17 18:01:37,796 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 18:01:37,798 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:37,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34575,1676656897411}] 2023-02-17 18:01:37,798 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:37,953 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:37,953 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:37,955 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54308, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:37,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 18:01:37,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:37,960 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34575%2C1676656897411.meta, suffix=.meta, logDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/WALs/jenkins-hbase4.apache.org,34575,1676656897411, archiveDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/oldWALs, maxLogs=32 2023-02-17 18:01:37,974 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43871,DS-f4a12c43-6e09-42b0-8b38-35954168394e,DISK] 2023-02-17 18:01:37,974 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33429,DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2,DISK] 2023-02-17 18:01:37,976 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/WALs/jenkins-hbase4.apache.org,34575,1676656897411/jenkins-hbase4.apache.org%2C34575%2C1676656897411.meta.1676656897961.meta 2023-02-17 18:01:37,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33429,DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2,DISK], DatanodeInfoWithStorage[127.0.0.1:43871,DS-f4a12c43-6e09-42b0-8b38-35954168394e,DISK]] 2023-02-17 18:01:37,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:37,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 18:01:37,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 18:01:37,977 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 18:01:37,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 18:01:37,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:37,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 18:01:37,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 18:01:37,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:37,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/info 2023-02-17 18:01:37,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/info 2023-02-17 18:01:37,979 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:37,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:37,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:37,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:37,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:37,981 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:37,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:37,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:37,982 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/table 2023-02-17 18:01:37,982 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/table 2023-02-17 18:01:37,982 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:37,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:37,983 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740 2023-02-17 18:01:37,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740 2023-02-17 18:01:37,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:37,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:37,988 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63457888, jitterRate=-0.05440378189086914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:37,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:37,989 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676656897953 2023-02-17 18:01:37,992 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 18:01:37,993 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 18:01:37,993 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34575,1676656897411, state=OPEN 2023-02-17 18:01:37,994 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 18:01:37,994 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:37,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 18:01:37,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34575,1676656897411 in 196 msec 2023-02-17 18:01:37,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 18:01:37,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 364 msec 2023-02-17 18:01:37,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 407 msec 2023-02-17 18:01:37,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676656897998, completionTime=-1 2023-02-17 18:01:37,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 18:01:37,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 18:01:38,002 DEBUG [hconnection-0x78e779b7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:38,003 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54312, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:38,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 18:01:38,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676656958005 2023-02-17 18:01:38,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676657018005 2023-02-17 18:01:38,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-17 18:01:38,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37103,1676656897284-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:38,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37103,1676656897284-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:38,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37103,1676656897284-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:38,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37103, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:38,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:38,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 18:01:38,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:38,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 18:01:38,016 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 18:01:38,017 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:38,017 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:38,019 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:38,020 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65 empty. 2023-02-17 18:01:38,020 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:38,020 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 18:01:38,040 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:38,042 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => bf04ee80f25d48ec7d863699da6c7f65, NAME => 'hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp 2023-02-17 18:01:38,050 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:38,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing bf04ee80f25d48ec7d863699da6c7f65, disabling compactions & flushes 2023-02-17 18:01:38,051 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:38,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:38,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. after waiting 0 ms 2023-02-17 18:01:38,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:38,051 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:38,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for bf04ee80f25d48ec7d863699da6c7f65: 2023-02-17 18:01:38,056 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:38,057 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656898057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656898057"}]},"ts":"1676656898057"} 2023-02-17 18:01:38,059 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:38,060 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:38,060 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656898060"}]},"ts":"1676656898060"} 2023-02-17 18:01:38,062 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 18:01:38,066 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:38,067 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:38,067 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:38,067 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:38,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bf04ee80f25d48ec7d863699da6c7f65, ASSIGN}] 2023-02-17 18:01:38,071 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=bf04ee80f25d48ec7d863699da6c7f65, ASSIGN 2023-02-17 18:01:38,072 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=bf04ee80f25d48ec7d863699da6c7f65, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34575,1676656897411; forceNewPlan=false, retain=false 2023-02-17 18:01:38,222 INFO [jenkins-hbase4:37103] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:38,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bf04ee80f25d48ec7d863699da6c7f65, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:38,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656898223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656898223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656898223"}]},"ts":"1676656898223"} 2023-02-17 18:01:38,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure bf04ee80f25d48ec7d863699da6c7f65, server=jenkins-hbase4.apache.org,34575,1676656897411}] 2023-02-17 18:01:38,380 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:38,382 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34575%2C1676656897411, suffix=, logDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/WALs/jenkins-hbase4.apache.org,34575,1676656897411, archiveDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/oldWALs, maxLogs=32 2023-02-17 18:01:38,398 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43871,DS-f4a12c43-6e09-42b0-8b38-35954168394e,DISK] 2023-02-17 18:01:38,399 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33429,DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2,DISK] 2023-02-17 18:01:38,401 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/WALs/jenkins-hbase4.apache.org,34575,1676656897411/jenkins-hbase4.apache.org%2C34575%2C1676656897411.1676656898382 2023-02-17 18:01:38,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43871,DS-f4a12c43-6e09-42b0-8b38-35954168394e,DISK], DatanodeInfoWithStorage[127.0.0.1:33429,DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2,DISK]] 2023-02-17 18:01:38,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bf04ee80f25d48ec7d863699da6c7f65, NAME => 'hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:38,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:38,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:38,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:38,404 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:38,406 INFO [StoreOpener-bf04ee80f25d48ec7d863699da6c7f65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:38,408 DEBUG [StoreOpener-bf04ee80f25d48ec7d863699da6c7f65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65/info 2023-02-17 18:01:38,408 DEBUG [StoreOpener-bf04ee80f25d48ec7d863699da6c7f65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65/info 2023-02-17 18:01:38,408 INFO [StoreOpener-bf04ee80f25d48ec7d863699da6c7f65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf04ee80f25d48ec7d863699da6c7f65 columnFamilyName info 2023-02-17 18:01:38,409 INFO [StoreOpener-bf04ee80f25d48ec7d863699da6c7f65-1] regionserver.HStore(310): Store=bf04ee80f25d48ec7d863699da6c7f65/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:38,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:38,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:38,413 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:38,416 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:38,417 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bf04ee80f25d48ec7d863699da6c7f65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59078704, jitterRate=-0.1196587085723877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:38,417 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bf04ee80f25d48ec7d863699da6c7f65: 2023-02-17 18:01:38,418 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65., pid=6, masterSystemTime=1676656898377 2023-02-17 18:01:38,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:38,420 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:38,420 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=bf04ee80f25d48ec7d863699da6c7f65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:38,420 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656898420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656898420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656898420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656898420"}]},"ts":"1676656898420"} 2023-02-17 18:01:38,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 18:01:38,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure bf04ee80f25d48ec7d863699da6c7f65, server=jenkins-hbase4.apache.org,34575,1676656897411 in 197 msec 2023-02-17 18:01:38,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 18:01:38,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=bf04ee80f25d48ec7d863699da6c7f65, ASSIGN in 355 msec 2023-02-17 18:01:38,426 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:38,426 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656898426"}]},"ts":"1676656898426"} 2023-02-17 18:01:38,429 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 18:01:38,431 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:38,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 417 msec 2023-02-17 18:01:38,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 18:01:38,518 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:38,518 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:38,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 18:01:38,534 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:38,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-02-17 18:01:38,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 18:01:38,550 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:38,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-17 18:01:38,558 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 18:01:38,560 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 18:01:38,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.124sec 2023-02-17 18:01:38,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 18:01:38,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 18:01:38,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 18:01:38,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37103,1676656897284-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 18:01:38,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37103,1676656897284-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 18:01:38,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 18:01:38,631 DEBUG [Listener at localhost/33553] zookeeper.ReadOnlyZKClient(139): Connect 0x6e445c47 to 127.0.0.1:58388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:38,637 DEBUG [Listener at localhost/33553] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c28f179, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:38,638 DEBUG [hconnection-0x7ee54b6a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:38,640 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54328, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:38,642 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:38,642 DEBUG [Listener at localhost/33553] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 18:01:38,645 DEBUG [Listener at localhost/33553] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 18:01:38,646 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44192, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 18:01:38,647 INFO [Listener at localhost/33553] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:38,648 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 18:01:38,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:44192 deadline: 1676656958648, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:38,648 INFO [Listener at localhost/33553] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-17 18:01:38,651 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:38,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:38,654 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:38,654 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-17 18:01:38,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:38,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:38,657 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:38,657 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c empty. 2023-02-17 18:01:38,658 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:38,658 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-17 18:01:38,673 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:38,674 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 756cc104bb84f664d07024b34e2ce78c, NAME => 'testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp 2023-02-17 18:01:38,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:38,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 756cc104bb84f664d07024b34e2ce78c, disabling compactions & flushes 2023-02-17 18:01:38,682 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:38,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:38,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. after waiting 0 ms 2023-02-17 18:01:38,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:38,682 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:38,682 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 756cc104bb84f664d07024b34e2ce78c: 2023-02-17 18:01:38,685 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:38,686 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676656898686"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656898686"}]},"ts":"1676656898686"} 2023-02-17 18:01:38,688 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:38,688 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:38,689 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656898689"}]},"ts":"1676656898689"} 2023-02-17 18:01:38,690 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-17 18:01:38,694 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:38,695 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:38,695 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:38,695 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:38,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=756cc104bb84f664d07024b34e2ce78c, ASSIGN}] 2023-02-17 18:01:38,698 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=756cc104bb84f664d07024b34e2ce78c, ASSIGN 2023-02-17 18:01:38,699 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=756cc104bb84f664d07024b34e2ce78c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36265,1676656897348; forceNewPlan=false, retain=false 2023-02-17 18:01:38,749 INFO [RS:0;jenkins-hbase4:36265] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36265%2C1676656897348, suffix=, logDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/WALs/jenkins-hbase4.apache.org,36265,1676656897348, archiveDir=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/oldWALs, maxLogs=32 2023-02-17 18:01:38,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:38,766 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43871,DS-f4a12c43-6e09-42b0-8b38-35954168394e,DISK] 2023-02-17 18:01:38,766 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33429,DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2,DISK] 2023-02-17 18:01:38,768 INFO [RS:0;jenkins-hbase4:36265] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/WALs/jenkins-hbase4.apache.org,36265,1676656897348/jenkins-hbase4.apache.org%2C36265%2C1676656897348.1676656898750 2023-02-17 18:01:38,768 DEBUG [RS:0;jenkins-hbase4:36265] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43871,DS-f4a12c43-6e09-42b0-8b38-35954168394e,DISK], DatanodeInfoWithStorage[127.0.0.1:33429,DS-671548fa-7aef-4cac-ac3f-b49e3ef229f2,DISK]] 2023-02-17 18:01:38,849 INFO [jenkins-hbase4:37103] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:38,850 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=756cc104bb84f664d07024b34e2ce78c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:38,850 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676656898850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656898850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656898850"}]},"ts":"1676656898850"} 2023-02-17 18:01:38,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 756cc104bb84f664d07024b34e2ce78c, server=jenkins-hbase4.apache.org,36265,1676656897348}] 2023-02-17 18:01:38,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:39,006 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,006 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:39,007 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38226, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:39,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 756cc104bb84f664d07024b34e2ce78c, NAME => 'testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:39,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:39,013 INFO [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:39,014 DEBUG [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1 2023-02-17 18:01:39,015 DEBUG [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1 2023-02-17 18:01:39,015 INFO [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 756cc104bb84f664d07024b34e2ce78c columnFamilyName f1 2023-02-17 18:01:39,015 INFO [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] regionserver.HStore(310): Store=756cc104bb84f664d07024b34e2ce78c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:39,015 INFO [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:39,016 DEBUG [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2 2023-02-17 18:01:39,016 DEBUG [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2 2023-02-17 18:01:39,017 INFO [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 756cc104bb84f664d07024b34e2ce78c columnFamilyName f2 2023-02-17 18:01:39,017 INFO [StoreOpener-756cc104bb84f664d07024b34e2ce78c-1] regionserver.HStore(310): Store=756cc104bb84f664d07024b34e2ce78c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:39,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:39,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:39,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:39,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:39,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:39,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 756cc104bb84f664d07024b34e2ce78c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61784805, jitterRate=-0.07933466136455536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:39,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 756cc104bb84f664d07024b34e2ce78c: 2023-02-17 18:01:39,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c., pid=12, masterSystemTime=1676656899006 2023-02-17 18:01:39,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:39,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:39,028 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=756cc104bb84f664d07024b34e2ce78c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,028 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676656899028"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656899028"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656899028"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656899028"}]},"ts":"1676656899028"} 2023-02-17 18:01:39,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 18:01:39,031 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 756cc104bb84f664d07024b34e2ce78c, server=jenkins-hbase4.apache.org,36265,1676656897348 in 176 msec 2023-02-17 18:01:39,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 18:01:39,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=756cc104bb84f664d07024b34e2ce78c, ASSIGN in 335 msec 2023-02-17 18:01:39,033 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:39,033 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656899033"}]},"ts":"1676656899033"} 2023-02-17 18:01:39,034 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-17 18:01:39,036 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:39,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 385 msec 2023-02-17 18:01:39,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:39,261 INFO [Listener at localhost/33553] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-17 18:01:39,261 DEBUG [Listener at localhost/33553] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-17 18:01:39,261 INFO [Listener at localhost/33553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:39,263 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-17 18:01:39,263 INFO [Listener at localhost/33553] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:39,264 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-17 18:01:39,264 INFO [Listener at localhost/33553] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 18:01:39,286 DEBUG [hconnection-0x7ee54b6a-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:39,306 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38242, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:39,313 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36265] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:39,406 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 18:01:39,455 INFO [Listener at localhost/33553] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 18:01:39,455 INFO [Listener at localhost/33553] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 18:01:39,456 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-17 18:01:39,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676656899456 (current time:1676656899456). 2023-02-17 18:01:39,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 18:01:39,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] zookeeper.ReadOnlyZKClient(139): Connect 0x5b745b14 to 127.0.0.1:58388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:39,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40774123, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:39,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:39,469 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54332, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:39,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b745b14 to 127.0.0.1:58388 2023-02-17 18:01:39,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:39,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 18:01:39,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-17 18:01:39,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-17 18:01:39,474 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-17 18:01:39,474 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676657499474 2023-02-17 18:01:39,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-17 18:01:39,475 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,475 DEBUG [Listener at localhost/33553] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:39,476 DEBUG [Listener at localhost/33553] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 18:01:39,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-17 18:01:39,476 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-17 18:01:39,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-17 18:01:39,478 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-17 18:01:39,478 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676657499478 2023-02-17 18:01:39,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-17 18:01:39,488 INFO [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-17 18:01:39,488 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:39,489 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-17 18:01:39,489 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-17 18:01:39,490 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,490 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:39,491 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:39,491 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:39,491 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:39,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:39,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:39,492 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,492 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 18:01:39,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 18:01:39,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-17 18:01:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-17 18:01:39,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:39,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-17 18:01:39,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-17 18:01:39,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 18:01:39,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 18:01:39,493 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 18:01:39,493 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:39,493 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 18:01:39,494 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 18:01:39,494 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 18:01:39,494 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:39,494 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36265,1676656897348' joining acquired barrier for procedure (foo) in zk 2023-02-17 18:01:39,494 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 18:01:39,495 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 18:01:39,495 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34575,1676656897411' joining acquired barrier for procedure (foo) in zk 2023-02-17 18:01:39,496 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,496 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:39,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:39,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:39,498 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,498 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,498 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:39,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,499 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:39,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:39,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:39,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36265,1676656897348' joining acquired barrier for procedure 'foo' on coordinator 2023-02-17 18:01:39,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25786ff8[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:39,501 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-17 18:01:39,501 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,502 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,502 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 18:01:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 18:01:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 18:01:39,503 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,503 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34575,1676656897411' in zk 2023-02-17 18:01:39,505 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 18:01:39,505 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:39,506 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 18:01:39,508 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 18:01:39,508 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:01:39,508 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:39,508 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. started... 2023-02-17 18:01:39,509 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 756cc104bb84f664d07024b34e2ce78c 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 18:01:39,532 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/.tmp/f1/e7a71e9a2ed040468c235b8fb34f2888 2023-02-17 18:01:39,549 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/.tmp/f2/a318d6d135a8460792afc9907bd9bf53 2023-02-17 18:01:39,554 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/.tmp/f1/e7a71e9a2ed040468c235b8fb34f2888 as hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/e7a71e9a2ed040468c235b8fb34f2888 2023-02-17 18:01:39,558 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/e7a71e9a2ed040468c235b8fb34f2888, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 18:01:39,559 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/.tmp/f2/a318d6d135a8460792afc9907bd9bf53 as hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/a318d6d135a8460792afc9907bd9bf53 2023-02-17 18:01:39,563 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/a318d6d135a8460792afc9907bd9bf53, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 18:01:39,564 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 756cc104bb84f664d07024b34e2ce78c in 55ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:39,564 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-17 18:01:39,565 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 756cc104bb84f664d07024b34e2ce78c: 2023-02-17 18:01:39,565 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.' region-info for snapshot=foo 2023-02-17 18:01:39,565 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:39,565 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/e7a71e9a2ed040468c235b8fb34f2888] hfiles 2023-02-17 18:01:39,565 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/e7a71e9a2ed040468c235b8fb34f2888 for snapshot=foo 2023-02-17 18:01:39,565 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/a318d6d135a8460792afc9907bd9bf53] hfiles 2023-02-17 18:01:39,565 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/a318d6d135a8460792afc9907bd9bf53 for snapshot=foo 2023-02-17 18:01:39,575 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. completed. 2023-02-17 18:01:39,575 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 18:01:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 18:01:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 18:01:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,36265,1676656897348' in zk 2023-02-17 18:01:39,576 DEBUG [Listener at localhost/33553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:39,577 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 18:01:39,577 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,577 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:39,577 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 18:01:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:39,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-17 18:01:39,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:39,579 DEBUG [Listener at localhost/33553] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 18:01:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,36265,1676656897348': 2023-02-17 18:01:39,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36265,1676656897348' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-17 18:01:39,581 INFO [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-17 18:01:39,581 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:39,581 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:39,581 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-17 18:01:39,581 INFO [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 18:01:39,583 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,583 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:39,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:39,583 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,584 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:39,583 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:39,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:39,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,584 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:39,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:39,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:39,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:39,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:39,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:39,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,584 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:39,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:39,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:39,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:39,586 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:39,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:39,586 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:39,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:39,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:39,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:39,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-17 18:01:39,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-17 18:01:39,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:39,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:39,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:39,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:39,592 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:39,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:39,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:39,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:39,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:39,593 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,593 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,593 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:39,593 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 18:01:39,593 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 18:01:39,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:39,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:39,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.hbase-snapshot/.tmp/foo 2023-02-17 18:01:39,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:39,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:39,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.hbase-snapshot/.tmp/foo to hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.hbase-snapshot/foo 2023-02-17 18:01:39,625 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-17 18:01:39,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.hbase-snapshot/.tmp/foo 2023-02-17 18:01:39,625 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.hbase-snapshot/.tmp/foo 2023-02-17 18:01:39,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676656899475Consolidate snapshot: foo at 1676656899592 (+117 ms)Loading Region manifests for foo at 1676656899592Writing data manifest for foo at 1676656899596 (+4 ms)Verifying snapshot: foo at 1676656899604 (+8 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676656899625 (+21 ms) 2023-02-17 18:01:39,626 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-17 18:01:39,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 152 msec 2023-02-17 18:01:39,779 DEBUG [Listener at localhost/33553] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:39,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-17 18:01:39,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 18:01:39,782 INFO [Listener at localhost/33553] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 18:01:39,787 INFO [Listener at localhost/33553] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 18:01:39,814 INFO [Listener at localhost/33553] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 18:01:39,861 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36265] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:39,950 INFO [Listener at localhost/33553] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 18:01:39,956 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 18:01:39,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,958 INFO [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-17 18:01:39,958 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:39,959 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-17 18:01:39,959 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-17 18:01:39,959 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,959 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,961 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:39,961 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:39,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:39,961 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:39,961 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:39,961 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,962 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,962 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-17 18:01:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-17 18:01:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-17 18:01:39,967 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-17 18:01:39,967 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-17 18:01:39,967 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34575,1676656897411' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-17 18:01:39,967 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 18:01:39,967 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:01:39,967 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:39,967 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. started... 2023-02-17 18:01:39,967 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 756cc104bb84f664d07024b34e2ce78c 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 18:01:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:39,985 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/.tmp/f1/6d3b8a249c6841a591b20dd91b592eac 2023-02-17 18:01:40,005 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/.tmp/f2/ed90b0094aad43d28c7f04e33322dddb 2023-02-17 18:01:40,010 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/.tmp/f1/6d3b8a249c6841a591b20dd91b592eac as hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/6d3b8a249c6841a591b20dd91b592eac 2023-02-17 18:01:40,014 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/6d3b8a249c6841a591b20dd91b592eac, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 18:01:40,014 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/.tmp/f2/ed90b0094aad43d28c7f04e33322dddb as hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/ed90b0094aad43d28c7f04e33322dddb 2023-02-17 18:01:40,018 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/ed90b0094aad43d28c7f04e33322dddb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 18:01:40,019 INFO [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 756cc104bb84f664d07024b34e2ce78c in 52ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:40,020 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 756cc104bb84f664d07024b34e2ce78c: 2023-02-17 18:01:40,020 DEBUG [rs(jenkins-hbase4.apache.org,36265,1676656897348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:40,020 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 18:01:40,020 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 18:01:40,020 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,020 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-17 18:01:40,020 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36265,1676656897348' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-17 18:01:40,023 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,023 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:40,024 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,024 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36265,1676656897348' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-17 18:01:40,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2147ff8f[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:40,026 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-17 18:01:40,027 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,028 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,028 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,028 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-17 18:01:40,028 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,028 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:40,028 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-17 18:01:40,028 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-17 18:01:40,028 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-17 18:01:40,028 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,34575,1676656897411' in zk 2023-02-17 18:01:40,028 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,36265,1676656897348' in zk 2023-02-17 18:01:40,030 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-17 18:01:40,030 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:40,030 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,030 DEBUG [member: 'jenkins-hbase4.apache.org,34575,1676656897411' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-17 18:01:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:40,031 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-17 18:01:40,031 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:40,031 DEBUG [member: 'jenkins-hbase4.apache.org,36265,1676656897348' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-17 18:01:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,36265,1676656897348': 2023-02-17 18:01:40,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36265,1676656897348' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-17 18:01:40,035 INFO [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-17 18:01:40,035 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:40,035 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:40,035 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,035 INFO [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 18:01:40,037 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,037 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,038 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,037 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:40,038 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:40,038 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:40,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,039 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:40,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:40,040 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,041 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,044 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:40,044 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:40,044 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:40,044 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:40,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:40,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:40,044 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:40,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:40,044 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-17 18:01:40,045 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 18:01:40,044 DEBUG [(jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:40,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:40,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:40,044 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,046 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,046 DEBUG [Listener at localhost/33553] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:40,046 DEBUG [Listener at localhost/33553] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 18:01:40,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:40,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:40,046 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,046 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,046 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,046 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,046 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,046 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,146 DEBUG [Listener at localhost/33553] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 18:01:40,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 18:01:40,152 INFO [Listener at localhost/33553] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676656899456 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:40,152 DEBUG [Listener at localhost/33553] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:32807/user/jenkins/test-data/7ae6c726-627e-dc16-b35a-391d18db83d4/foo/24bbeb4b-a60e-465a-a9e4-12bf88cfb1ee/data/default/testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,152 INFO [Listener at localhost/33553] snapshot.RestoreSnapshotHelper(239): region to add: 756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:40,153 INFO [Listener at localhost/33553] snapshot.RestoreSnapshotHelper(585): clone region=756cc104bb84f664d07024b34e2ce78c as 756cc104bb84f664d07024b34e2ce78c in snapshot foo 2023-02-17 18:01:40,153 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 756cc104bb84f664d07024b34e2ce78c, NAME => 'testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32807/user/jenkins/test-data/7ae6c726-627e-dc16-b35a-391d18db83d4/foo/24bbeb4b-a60e-465a-a9e4-12bf88cfb1ee 2023-02-17 18:01:40,159 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:40,160 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e7a71e9a2ed040468c235b8fb34f2888 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,161 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a318d6d135a8460792afc9907bd9bf53 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,163 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 756cc104bb84f664d07024b34e2ce78c, disabling compactions & flushes 2023-02-17 18:01:40,163 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:40,163 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:40,163 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. after waiting 0 ms 2023-02-17 18:01:40,163 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:40,163 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:40,163 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 756cc104bb84f664d07024b34e2ce78c: 2023-02-17 18:01:40,164 INFO [Listener at localhost/33553] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676656899456 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:40,164 DEBUG [Listener at localhost/33553] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:32807/user/jenkins/test-data/7ae6c726-627e-dc16-b35a-391d18db83d4/foo/24bbeb4b-a60e-465a-a9e4-12bf88cfb1ee 2023-02-17 18:01:40,164 DEBUG [Listener at localhost/33553] util.CommonFSUtils(682): File system contents for path hdfs://localhost:32807/user/jenkins/test-data/7ae6c726-627e-dc16-b35a-391d18db83d4/foo/24bbeb4b-a60e-465a-a9e4-12bf88cfb1ee 2023-02-17 18:01:40,164 DEBUG [Listener at localhost/33553] util.CommonFSUtils(699): |-data/ 2023-02-17 18:01:40,165 DEBUG [Listener at localhost/33553] util.CommonFSUtils(699): |----default/ 2023-02-17 18:01:40,165 DEBUG [Listener at localhost/33553] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-17 18:01:40,165 DEBUG [Listener at localhost/33553] util.CommonFSUtils(699): |----------756cc104bb84f664d07024b34e2ce78c/ 2023-02-17 18:01:40,166 DEBUG [Listener at localhost/33553] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:40,166 DEBUG [Listener at localhost/33553] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:40,166 DEBUG [Listener at localhost/33553] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=756cc104bb84f664d07024b34e2ce78c-e7a71e9a2ed040468c235b8fb34f2888 2023-02-17 18:01:40,166 DEBUG [Listener at localhost/33553] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:40,167 DEBUG [Listener at localhost/33553] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=756cc104bb84f664d07024b34e2ce78c-a318d6d135a8460792afc9907bd9bf53 2023-02-17 18:01:40,168 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-17 18:01:40,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-17 18:01:40,171 INFO [Listener at localhost/33553] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,171 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,176 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656900176"}]},"ts":"1676656900176"} 2023-02-17 18:01:40,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:01:40,177 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-17 18:01:40,179 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-17 18:01:40,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=756cc104bb84f664d07024b34e2ce78c, UNASSIGN}] 2023-02-17 18:01:40,180 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=756cc104bb84f664d07024b34e2ce78c, UNASSIGN 2023-02-17 18:01:40,181 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=756cc104bb84f664d07024b34e2ce78c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,181 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676656900181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656900181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656900181"}]},"ts":"1676656900181"} 2023-02-17 18:01:40,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 756cc104bb84f664d07024b34e2ce78c, server=jenkins-hbase4.apache.org,36265,1676656897348}] 2023-02-17 18:01:40,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:01:40,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:40,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 756cc104bb84f664d07024b34e2ce78c, disabling compactions & flushes 2023-02-17 18:01:40,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:40,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:40,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. after waiting 0 ms 2023-02-17 18:01:40,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:40,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:40,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c. 2023-02-17 18:01:40,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 756cc104bb84f664d07024b34e2ce78c: 2023-02-17 18:01:40,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:40,342 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=756cc104bb84f664d07024b34e2ce78c, regionState=CLOSED 2023-02-17 18:01:40,342 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676656900342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656900342"}]},"ts":"1676656900342"} 2023-02-17 18:01:40,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 18:01:40,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 756cc104bb84f664d07024b34e2ce78c, server=jenkins-hbase4.apache.org,36265,1676656897348 in 161 msec 2023-02-17 18:01:40,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 18:01:40,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=756cc104bb84f664d07024b34e2ce78c, UNASSIGN in 165 msec 2023-02-17 18:01:40,346 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656900346"}]},"ts":"1676656900346"} 2023-02-17 18:01:40,347 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-17 18:01:40,349 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-17 18:01:40,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 178 msec 2023-02-17 18:01:40,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:01:40,479 INFO [Listener at localhost/33553] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-17 18:01:40,480 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,482 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,483 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 18:01:40,486 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:40,488 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2, FileablePath, hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/recovered.edits] 2023-02-17 18:01:40,491 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/6d3b8a249c6841a591b20dd91b592eac to hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/archive/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/6d3b8a249c6841a591b20dd91b592eac 2023-02-17 18:01:40,492 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/e7a71e9a2ed040468c235b8fb34f2888 to hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/archive/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f1/e7a71e9a2ed040468c235b8fb34f2888 2023-02-17 18:01:40,494 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/a318d6d135a8460792afc9907bd9bf53 to hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/archive/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/a318d6d135a8460792afc9907bd9bf53 2023-02-17 18:01:40,495 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/ed90b0094aad43d28c7f04e33322dddb to hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/archive/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/f2/ed90b0094aad43d28c7f04e33322dddb 2023-02-17 18:01:40,497 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/recovered.edits/12.seqid to hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/archive/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c/recovered.edits/12.seqid 2023-02-17 18:01:40,498 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/.tmp/data/default/testInitTableSnapshotMapperJobConfig/756cc104bb84f664d07024b34e2ce78c 2023-02-17 18:01:40,498 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-17 18:01:40,500 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,502 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-17 18:01:40,503 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-17 18:01:40,504 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,504 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-17 18:01:40,504 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656900504"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:40,506 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 18:01:40,506 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 756cc104bb84f664d07024b34e2ce78c, NAME => 'testInitTableSnapshotMapperJobConfig,,1676656898650.756cc104bb84f664d07024b34e2ce78c.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 18:01:40,506 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-17 18:01:40,506 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676656900506"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:40,509 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-17 18:01:40,512 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-17 18:01:40,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 32 msec 2023-02-17 18:01:40,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 18:01:40,585 INFO [Listener at localhost/33553] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-17 18:01:40,585 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 18:01:40,585 INFO [Listener at localhost/33553] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 18:01:40,586 DEBUG [Listener at localhost/33553] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e445c47 to 127.0.0.1:58388 2023-02-17 18:01:40,586 DEBUG [Listener at localhost/33553] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:40,586 DEBUG [Listener at localhost/33553] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 18:01:40,586 DEBUG [Listener at localhost/33553] util.JVMClusterUtil(257): Found active master hash=70286255, stopped=false 2023-02-17 18:01:40,586 INFO [Listener at localhost/33553] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:40,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:40,592 INFO [Listener at localhost/33553] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 18:01:40,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:40,592 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:40,597 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:40,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:40,597 DEBUG [Listener at localhost/33553] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76bf6441 to 127.0.0.1:58388 2023-02-17 18:01:40,597 DEBUG [Listener at localhost/33553] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:40,598 INFO [Listener at localhost/33553] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36265,1676656897348' ***** 2023-02-17 18:01:40,598 INFO [Listener at localhost/33553] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:40,598 INFO [Listener at localhost/33553] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34575,1676656897411' ***** 2023-02-17 18:01:40,599 INFO [Listener at localhost/33553] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:40,599 INFO [RS:1;jenkins-hbase4:34575] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:40,599 INFO [RS:1;jenkins-hbase4:34575] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:40,599 INFO [RS:1;jenkins-hbase4:34575] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:40,599 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(3304): Received CLOSE for bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:40,599 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:40,604 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,604 DEBUG [RS:1;jenkins-hbase4:34575] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ace3f91 to 127.0.0.1:58388 2023-02-17 18:01:40,604 DEBUG [RS:1;jenkins-hbase4:34575] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:40,604 INFO [RS:1;jenkins-hbase4:34575] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:40,604 INFO [RS:1;jenkins-hbase4:34575] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:40,604 INFO [RS:1;jenkins-hbase4:34575] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:40,604 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 18:01:40,604 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 18:01:40,605 INFO [RS:0;jenkins-hbase4:36265] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:40,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bf04ee80f25d48ec7d863699da6c7f65, disabling compactions & flushes 2023-02-17 18:01:40,606 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:40,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:40,606 INFO [RS:0;jenkins-hbase4:36265] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:40,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:40,607 INFO [RS:0;jenkins-hbase4:36265] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:40,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. after waiting 0 ms 2023-02-17 18:01:40,606 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:40,605 DEBUG [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1479): Online Regions={bf04ee80f25d48ec7d863699da6c7f65=hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65., 1588230740=hbase:meta,,1.1588230740} 2023-02-17 18:01:40,607 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:40,607 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:40,607 DEBUG [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1505): Waiting on 1588230740, bf04ee80f25d48ec7d863699da6c7f65 2023-02-17 18:01:40,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:40,607 INFO [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing bf04ee80f25d48ec7d863699da6c7f65 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 18:01:40,607 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:40,607 DEBUG [RS:0;jenkins-hbase4:36265] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7800aa02 to 127.0.0.1:58388 2023-02-17 18:01:40,607 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:40,607 DEBUG [RS:0;jenkins-hbase4:36265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:40,607 INFO [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36265,1676656897348; all regions closed. 2023-02-17 18:01:40,608 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-17 18:01:40,612 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:40,619 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/WALs/jenkins-hbase4.apache.org,36265,1676656897348/jenkins-hbase4.apache.org%2C36265%2C1676656897348.1676656898750 not finished, retry = 0 2023-02-17 18:01:40,634 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:40,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65/.tmp/info/532f9d8fd5e34bf6b1fdc3e1b2a01c03 2023-02-17 18:01:40,654 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/.tmp/info/c5fb7e73019346398d215835d8a9e3b2 2023-02-17 18:01:40,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5fb7e73019346398d215835d8a9e3b2 2023-02-17 18:01:40,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65/.tmp/info/532f9d8fd5e34bf6b1fdc3e1b2a01c03 as hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65/info/532f9d8fd5e34bf6b1fdc3e1b2a01c03 2023-02-17 18:01:40,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65/info/532f9d8fd5e34bf6b1fdc3e1b2a01c03, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 18:01:40,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for bf04ee80f25d48ec7d863699da6c7f65 in 58ms, sequenceid=6, compaction requested=false 2023-02-17 18:01:40,668 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/.tmp/rep_barrier/53323ee9391b4adba4c3958db67b8939 2023-02-17 18:01:40,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/namespace/bf04ee80f25d48ec7d863699da6c7f65/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 18:01:40,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:40,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bf04ee80f25d48ec7d863699da6c7f65: 2023-02-17 18:01:40,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676656898014.bf04ee80f25d48ec7d863699da6c7f65. 2023-02-17 18:01:40,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53323ee9391b4adba4c3958db67b8939 2023-02-17 18:01:40,683 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/.tmp/table/ffb0b5a675bc485b8a0dae293da09e03 2023-02-17 18:01:40,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffb0b5a675bc485b8a0dae293da09e03 2023-02-17 18:01:40,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/.tmp/info/c5fb7e73019346398d215835d8a9e3b2 as hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/info/c5fb7e73019346398d215835d8a9e3b2 2023-02-17 18:01:40,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5fb7e73019346398d215835d8a9e3b2 2023-02-17 18:01:40,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/info/c5fb7e73019346398d215835d8a9e3b2, entries=12, sequenceid=21, filesize=6.3 K 2023-02-17 18:01:40,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/.tmp/rep_barrier/53323ee9391b4adba4c3958db67b8939 as hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/rep_barrier/53323ee9391b4adba4c3958db67b8939 2023-02-17 18:01:40,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53323ee9391b4adba4c3958db67b8939 2023-02-17 18:01:40,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/rep_barrier/53323ee9391b4adba4c3958db67b8939, entries=1, sequenceid=21, filesize=5.0 K 2023-02-17 18:01:40,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:40,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:40,701 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/.tmp/table/ffb0b5a675bc485b8a0dae293da09e03 as hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/table/ffb0b5a675bc485b8a0dae293da09e03 2023-02-17 18:01:40,705 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffb0b5a675bc485b8a0dae293da09e03 2023-02-17 18:01:40,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/table/ffb0b5a675bc485b8a0dae293da09e03, entries=4, sequenceid=21, filesize=5.1 K 2023-02-17 18:01:40,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 99ms, sequenceid=21, compaction requested=false 2023-02-17 18:01:40,710 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 18:01:40,710 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 18:01:40,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:40,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:40,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:40,721 DEBUG [RS:0;jenkins-hbase4:36265] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/oldWALs 2023-02-17 18:01:40,721 INFO [RS:0;jenkins-hbase4:36265] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36265%2C1676656897348:(num 1676656898750) 2023-02-17 18:01:40,721 DEBUG [RS:0;jenkins-hbase4:36265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:40,721 INFO [RS:0;jenkins-hbase4:36265] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:40,722 INFO [RS:0;jenkins-hbase4:36265] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:40,722 INFO [RS:0;jenkins-hbase4:36265] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:40,722 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:40,722 INFO [RS:0;jenkins-hbase4:36265] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:40,722 INFO [RS:0;jenkins-hbase4:36265] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:40,723 INFO [RS:0;jenkins-hbase4:36265] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36265 2023-02-17 18:01:40,729 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 18:01:40,729 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 18:01:40,730 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,730 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36265,1676656897348 2023-02-17 18:01:40,730 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:40,730 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:40,730 ERROR [Listener at localhost/33553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6841195e rejected from java.util.concurrent.ThreadPoolExecutor@6c7e808e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:40,730 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:40,730 ERROR [Listener at localhost/33553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78f4c4af rejected from java.util.concurrent.ThreadPoolExecutor@6c7e808e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:40,731 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36265,1676656897348] 2023-02-17 18:01:40,731 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36265,1676656897348; numProcessing=1 2023-02-17 18:01:40,732 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36265,1676656897348 already deleted, retry=false 2023-02-17 18:01:40,732 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36265,1676656897348 expired; onlineServers=1 2023-02-17 18:01:40,807 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34575,1676656897411; all regions closed. 2023-02-17 18:01:40,813 DEBUG [RS:1;jenkins-hbase4:34575] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/oldWALs 2023-02-17 18:01:40,813 INFO [RS:1;jenkins-hbase4:34575] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34575%2C1676656897411.meta:.meta(num 1676656897961) 2023-02-17 18:01:40,817 DEBUG [RS:1;jenkins-hbase4:34575] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/oldWALs 2023-02-17 18:01:40,817 INFO [RS:1;jenkins-hbase4:34575] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34575%2C1676656897411:(num 1676656898382) 2023-02-17 18:01:40,817 DEBUG [RS:1;jenkins-hbase4:34575] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:40,817 INFO [RS:1;jenkins-hbase4:34575] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:40,818 INFO [RS:1;jenkins-hbase4:34575] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:40,818 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:40,818 INFO [RS:1;jenkins-hbase4:34575] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34575 2023-02-17 18:01:40,820 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34575,1676656897411 2023-02-17 18:01:40,820 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:40,820 ERROR [Listener at localhost/33553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55a0e2ef rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:40,824 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34575,1676656897411] 2023-02-17 18:01:40,824 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34575,1676656897411; numProcessing=2 2023-02-17 18:01:40,825 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34575,1676656897411 already deleted, retry=false 2023-02-17 18:01:40,825 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34575,1676656897411 expired; onlineServers=0 2023-02-17 18:01:40,825 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37103,1676656897284' ***** 2023-02-17 18:01:40,825 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 18:01:40,826 DEBUG [M:0;jenkins-hbase4:37103] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@feff1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:40,826 INFO [M:0;jenkins-hbase4:37103] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37103,1676656897284 2023-02-17 18:01:40,826 INFO [M:0;jenkins-hbase4:37103] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37103,1676656897284; all regions closed. 2023-02-17 18:01:40,826 DEBUG [M:0;jenkins-hbase4:37103] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:40,826 DEBUG [M:0;jenkins-hbase4:37103] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 18:01:40,826 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 18:01:40,826 DEBUG [M:0;jenkins-hbase4:37103] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 18:01:40,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656897597] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656897597,5,FailOnTimeoutGroup] 2023-02-17 18:01:40,826 INFO [M:0;jenkins-hbase4:37103] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 18:01:40,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656897598] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656897598,5,FailOnTimeoutGroup] 2023-02-17 18:01:40,827 INFO [M:0;jenkins-hbase4:37103] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 18:01:40,827 INFO [M:0;jenkins-hbase4:37103] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 18:01:40,827 DEBUG [M:0;jenkins-hbase4:37103] master.HMaster(1512): Stopping service threads 2023-02-17 18:01:40,828 INFO [M:0;jenkins-hbase4:37103] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 18:01:40,828 ERROR [M:0;jenkins-hbase4:37103] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 18:01:40,828 INFO [M:0;jenkins-hbase4:37103] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 18:01:40,828 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:40,828 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 18:01:40,828 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:40,829 DEBUG [M:0;jenkins-hbase4:37103] zookeeper.ZKUtil(398): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 18:01:40,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:40,829 WARN [M:0;jenkins-hbase4:37103] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 18:01:40,829 INFO [M:0;jenkins-hbase4:37103] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 18:01:40,829 INFO [M:0;jenkins-hbase4:37103] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 18:01:40,830 DEBUG [M:0;jenkins-hbase4:37103] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:40,830 INFO [M:0;jenkins-hbase4:37103] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:40,830 DEBUG [M:0;jenkins-hbase4:37103] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:40,830 DEBUG [M:0;jenkins-hbase4:37103] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:40,830 DEBUG [M:0;jenkins-hbase4:37103] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:40,830 INFO [M:0;jenkins-hbase4:37103] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.89 KB heapSize=66.83 KB 2023-02-17 18:01:40,839 INFO [M:0;jenkins-hbase4:37103] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.89 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e7f9abd76ea9455e9015d0bc41d1bd01 2023-02-17 18:01:40,843 DEBUG [M:0;jenkins-hbase4:37103] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e7f9abd76ea9455e9015d0bc41d1bd01 as hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e7f9abd76ea9455e9015d0bc41d1bd01 2023-02-17 18:01:40,847 INFO [M:0;jenkins-hbase4:37103] regionserver.HStore(1080): Added hdfs://localhost:32807/user/jenkins/test-data/77e8749b-f875-e2f0-f8e3-e126c35aa640/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e7f9abd76ea9455e9015d0bc41d1bd01, entries=17, sequenceid=132, filesize=8.7 K 2023-02-17 18:01:40,848 INFO [M:0;jenkins-hbase4:37103] regionserver.HRegion(2947): Finished flush of dataSize ~55.89 KB/57232, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-17 18:01:40,849 INFO [M:0;jenkins-hbase4:37103] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:40,849 DEBUG [M:0;jenkins-hbase4:37103] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:40,851 INFO [M:0;jenkins-hbase4:37103] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 18:01:40,851 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:40,852 INFO [M:0;jenkins-hbase4:37103] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37103 2023-02-17 18:01:40,853 DEBUG [M:0;jenkins-hbase4:37103] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37103,1676656897284 already deleted, retry=false 2023-02-17 18:01:40,900 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:40,900 INFO [RS:0;jenkins-hbase4:36265] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36265,1676656897348; zookeeper connection closed. 2023-02-17 18:01:40,900 ERROR [Listener at localhost/33553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fd306b rejected from java.util.concurrent.ThreadPoolExecutor@6c7e808e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:40,900 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:36265-0x1006371d6b80001, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:40,900 ERROR [Listener at localhost/33553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17dc8813 rejected from java.util.concurrent.ThreadPoolExecutor@6c7e808e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:40,900 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@67377030] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@67377030 2023-02-17 18:01:41,200 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:41,200 INFO [M:0;jenkins-hbase4:37103] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37103,1676656897284; zookeeper connection closed. 2023-02-17 18:01:41,201 ERROR [Listener at localhost/33553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7200cd6d rejected from java.util.concurrent.ThreadPoolExecutor@763f47f5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:41,201 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): master:37103-0x1006371d6b80000, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:41,201 ERROR [Listener at localhost/33553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@765b66b0 rejected from java.util.concurrent.ThreadPoolExecutor@763f47f5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:41,300 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:41,300 INFO [RS:1;jenkins-hbase4:34575] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34575,1676656897411; zookeeper connection closed. 2023-02-17 18:01:41,301 ERROR [Listener at localhost/33553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@77262d2b rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:41,301 DEBUG [Listener at localhost/33553-EventThread] zookeeper.ZKWatcher(600): regionserver:34575-0x1006371d6b80002, quorum=127.0.0.1:58388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:41,301 ERROR [Listener at localhost/33553-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f9285f5 rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:41,301 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c1cfed2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c1cfed2 2023-02-17 18:01:41,301 INFO [Listener at localhost/33553] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 18:01:41,301 WARN [Listener at localhost/33553] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:41,305 INFO [Listener at localhost/33553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:41,411 WARN [BP-481388813-172.31.14.131-1676656896593 heartbeating to localhost/127.0.0.1:32807] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:41,411 WARN [BP-481388813-172.31.14.131-1676656896593 heartbeating to localhost/127.0.0.1:32807] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-481388813-172.31.14.131-1676656896593 (Datanode Uuid a4a0aceb-edfb-4363-8655-0e89781daa25) service to localhost/127.0.0.1:32807 2023-02-17 18:01:41,412 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/cluster_d07f2f11-b29e-60ad-6d52-2d21d064e8a7/dfs/data/data3/current/BP-481388813-172.31.14.131-1676656896593] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:41,412 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/cluster_d07f2f11-b29e-60ad-6d52-2d21d064e8a7/dfs/data/data4/current/BP-481388813-172.31.14.131-1676656896593] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:41,414 WARN [Listener at localhost/33553] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:41,416 INFO [Listener at localhost/33553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:41,520 WARN [BP-481388813-172.31.14.131-1676656896593 heartbeating to localhost/127.0.0.1:32807] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:41,520 WARN [BP-481388813-172.31.14.131-1676656896593 heartbeating to localhost/127.0.0.1:32807] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-481388813-172.31.14.131-1676656896593 (Datanode Uuid 86921086-78b7-45d0-9182-9bf2af1b7b83) service to localhost/127.0.0.1:32807 2023-02-17 18:01:41,521 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/cluster_d07f2f11-b29e-60ad-6d52-2d21d064e8a7/dfs/data/data1/current/BP-481388813-172.31.14.131-1676656896593] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:41,521 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/cluster_d07f2f11-b29e-60ad-6d52-2d21d064e8a7/dfs/data/data2/current/BP-481388813-172.31.14.131-1676656896593] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:41,531 INFO [Listener at localhost/33553] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:41,645 INFO [Listener at localhost/33553] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 18:01:41,667 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 18:01:41,684 INFO [Listener at localhost/33553] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=181 (was 154) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:32807 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37103,1676656897284)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:32807 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:32807 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:32807 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:32807 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:32807 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:32807 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33553 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=564 (was 531) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=385 (was 419), ProcessCount=172 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=7155 (was 7308) 2023-02-17 18:01:41,697 INFO [Listener at localhost/33553] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=181, OpenFileDescriptor=564, MaxFileDescriptor=60000, SystemLoadAverage=385, ProcessCount=172, AvailableMemoryMB=7155 2023-02-17 18:01:41,713 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/hadoop.log.dir so I do NOT create it in target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f 2023-02-17 18:01:41,713 WARN [Listener at localhost/33553] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 18:01:41,713 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/hadoop.tmp.dir so I do NOT create it in target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f 2023-02-17 18:01:41,713 WARN [Listener at localhost/33553] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4213ec78-57f1-26b8-a0f7-ac568028e383/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 18:01:41,714 DEBUG [Listener at localhost/33553] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f 2023-02-17 18:01:41,714 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 18:01:41,714 INFO [Listener at localhost/33553] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/cluster_25ca2f20-097d-17db-5dc0-060b18adfe6b, deleteOnExit=true 2023-02-17 18:01:41,714 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 18:01:41,714 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/test.cache.data in system properties and HBase conf 2023-02-17 18:01:41,714 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 18:01:41,715 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/hadoop.log.dir in system properties and HBase conf 2023-02-17 18:01:41,715 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 18:01:41,715 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 18:01:41,715 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 18:01:41,715 DEBUG [Listener at localhost/33553] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 18:01:41,716 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:41,716 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:41,716 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 18:01:41,716 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:41,716 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 18:01:41,717 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 18:01:41,717 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:41,717 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:41,717 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 18:01:41,717 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/nfs.dump.dir in system properties and HBase conf 2023-02-17 18:01:41,717 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/java.io.tmpdir in system properties and HBase conf 2023-02-17 18:01:41,717 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:41,718 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 18:01:41,718 INFO [Listener at localhost/33553] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 18:01:41,723 WARN [Listener at localhost/33553] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:41,723 WARN [Listener at localhost/33553] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:41,764 WARN [Listener at localhost/33553] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:41,767 INFO [Listener at localhost/33553] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:41,772 INFO [Listener at localhost/33553] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/java.io.tmpdir/Jetty_localhost_37683_hdfs____.gjj4w9/webapp 2023-02-17 18:01:41,864 INFO [Listener at localhost/33553] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37683 2023-02-17 18:01:41,868 WARN [Listener at localhost/33553] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:41,869 WARN [Listener at localhost/33553] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:41,956 WARN [Listener at localhost/43825] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:41,976 WARN [Listener at localhost/43825] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:41,979 WARN [Listener at localhost/43825] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:41,980 INFO [Listener at localhost/43825] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:41,986 INFO [Listener at localhost/43825] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/java.io.tmpdir/Jetty_localhost_38219_datanode____.7xat6s/webapp 2023-02-17 18:01:42,087 INFO [Listener at localhost/43825] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38219 2023-02-17 18:01:42,096 WARN [Listener at localhost/37259] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:42,113 WARN [Listener at localhost/37259] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:42,115 WARN [Listener at localhost/37259] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:42,116 INFO [Listener at localhost/37259] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:42,123 INFO [Listener at localhost/37259] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/java.io.tmpdir/Jetty_localhost_45269_datanode____.20oibp/webapp 2023-02-17 18:01:42,197 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a2d5bd64e40f27: Processing first storage report for DS-295556e5-8662-4965-8785-1bbb9d341bde from datanode 999abd99-1b6d-4d3d-b30c-bdaac1b4a624 2023-02-17 18:01:42,197 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a2d5bd64e40f27: from storage DS-295556e5-8662-4965-8785-1bbb9d341bde node DatanodeRegistration(127.0.0.1:33441, datanodeUuid=999abd99-1b6d-4d3d-b30c-bdaac1b4a624, infoPort=36931, infoSecurePort=0, ipcPort=37259, storageInfo=lv=-57;cid=testClusterID;nsid=111400124;c=1676656901726), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:42,198 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a2d5bd64e40f27: Processing first storage report for DS-cc21534f-bf35-4c89-945c-5b4e75af5869 from datanode 999abd99-1b6d-4d3d-b30c-bdaac1b4a624 2023-02-17 18:01:42,198 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a2d5bd64e40f27: from storage DS-cc21534f-bf35-4c89-945c-5b4e75af5869 node DatanodeRegistration(127.0.0.1:33441, datanodeUuid=999abd99-1b6d-4d3d-b30c-bdaac1b4a624, infoPort=36931, infoSecurePort=0, ipcPort=37259, storageInfo=lv=-57;cid=testClusterID;nsid=111400124;c=1676656901726), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:42,226 INFO [Listener at localhost/37259] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45269 2023-02-17 18:01:42,235 WARN [Listener at localhost/34907] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:42,343 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71f933c7d1931efd: Processing first storage report for DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167 from datanode af96a624-9e7b-4e63-92d3-7bfacf80cb0f 2023-02-17 18:01:42,344 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71f933c7d1931efd: from storage DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167 node DatanodeRegistration(127.0.0.1:35669, datanodeUuid=af96a624-9e7b-4e63-92d3-7bfacf80cb0f, infoPort=35413, infoSecurePort=0, ipcPort=34907, storageInfo=lv=-57;cid=testClusterID;nsid=111400124;c=1676656901726), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:42,344 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71f933c7d1931efd: Processing first storage report for DS-a39057a6-9ae2-4498-a790-e4a86fc4bd59 from datanode af96a624-9e7b-4e63-92d3-7bfacf80cb0f 2023-02-17 18:01:42,344 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71f933c7d1931efd: from storage DS-a39057a6-9ae2-4498-a790-e4a86fc4bd59 node DatanodeRegistration(127.0.0.1:35669, datanodeUuid=af96a624-9e7b-4e63-92d3-7bfacf80cb0f, infoPort=35413, infoSecurePort=0, ipcPort=34907, storageInfo=lv=-57;cid=testClusterID;nsid=111400124;c=1676656901726), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:42,357 DEBUG [Listener at localhost/34907] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f 2023-02-17 18:01:42,368 INFO [Listener at localhost/34907] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/cluster_25ca2f20-097d-17db-5dc0-060b18adfe6b/zookeeper_0, clientPort=64475, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/cluster_25ca2f20-097d-17db-5dc0-060b18adfe6b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/cluster_25ca2f20-097d-17db-5dc0-060b18adfe6b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 18:01:42,369 INFO [Listener at localhost/34907] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64475 2023-02-17 18:01:42,370 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,371 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,392 INFO [Listener at localhost/34907] util.FSUtils(479): Created version file at hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff with version=8 2023-02-17 18:01:42,392 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,393 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,395 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/hbase-staging 2023-02-17 18:01:42,397 INFO [Listener at localhost/34907] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:42,398 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:42,398 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:42,398 INFO [Listener at localhost/34907] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:42,398 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:42,398 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:42,398 INFO [Listener at localhost/34907] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:42,399 INFO [Listener at localhost/34907] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35453 2023-02-17 18:01:42,400 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,401 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,402 INFO [Listener at localhost/34907] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35453 connecting to ZooKeeper ensemble=127.0.0.1:64475 2023-02-17 18:01:42,414 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:354530x0, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:42,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35453-0x1006371ea9b0000 connected 2023-02-17 18:01:42,435 DEBUG [Listener at localhost/34907] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:42,435 DEBUG [Listener at localhost/34907] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:42,435 DEBUG [Listener at localhost/34907] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:42,436 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35453 2023-02-17 18:01:42,436 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35453 2023-02-17 18:01:42,440 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35453 2023-02-17 18:01:42,441 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35453 2023-02-17 18:01:42,441 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35453 2023-02-17 18:01:42,442 INFO [Listener at localhost/34907] master.HMaster(444): hbase.rootdir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff, hbase.cluster.distributed=false 2023-02-17 18:01:42,458 INFO [Listener at localhost/34907] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:42,458 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:42,458 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:42,458 INFO [Listener at localhost/34907] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:42,458 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:42,458 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:42,458 INFO [Listener at localhost/34907] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:42,459 INFO [Listener at localhost/34907] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40377 2023-02-17 18:01:42,459 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:42,464 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:42,464 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,465 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,466 INFO [Listener at localhost/34907] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40377 connecting to ZooKeeper ensemble=127.0.0.1:64475 2023-02-17 18:01:42,471 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:403770x0, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:42,476 DEBUG [Listener at localhost/34907] zookeeper.ZKUtil(164): regionserver:403770x0, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:42,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40377-0x1006371ea9b0001 connected 2023-02-17 18:01:42,477 DEBUG [Listener at localhost/34907] zookeeper.ZKUtil(164): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:42,477 DEBUG [Listener at localhost/34907] zookeeper.ZKUtil(164): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:42,480 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40377 2023-02-17 18:01:42,480 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40377 2023-02-17 18:01:42,481 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40377 2023-02-17 18:01:42,481 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40377 2023-02-17 18:01:42,484 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40377 2023-02-17 18:01:42,496 INFO [Listener at localhost/34907] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:42,496 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:42,496 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:42,496 INFO [Listener at localhost/34907] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:42,496 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:42,496 INFO [Listener at localhost/34907] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:42,496 INFO [Listener at localhost/34907] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:42,497 INFO [Listener at localhost/34907] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43317 2023-02-17 18:01:42,498 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:42,501 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:42,502 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,503 INFO [Listener at localhost/34907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,504 INFO [Listener at localhost/34907] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43317 connecting to ZooKeeper ensemble=127.0.0.1:64475 2023-02-17 18:01:42,509 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:433170x0, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:42,510 DEBUG [Listener at localhost/34907] zookeeper.ZKUtil(164): regionserver:433170x0, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:42,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43317-0x1006371ea9b0002 connected 2023-02-17 18:01:42,511 DEBUG [Listener at localhost/34907] zookeeper.ZKUtil(164): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:42,512 DEBUG [Listener at localhost/34907] zookeeper.ZKUtil(164): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:42,514 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43317 2023-02-17 18:01:42,514 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43317 2023-02-17 18:01:42,516 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43317 2023-02-17 18:01:42,516 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43317 2023-02-17 18:01:42,517 DEBUG [Listener at localhost/34907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43317 2023-02-17 18:01:42,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:42,523 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:42,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:42,524 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:42,524 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:42,524 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:42,524 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:42,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:42,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:42,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35453,1676656902397 from backup master directory 2023-02-17 18:01:42,529 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:42,529 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:42,529 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:42,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:42,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/hbase.id with ID: 67f3d208-e8a7-494e-a00b-db5e31c74d6d 2023-02-17 18:01:42,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:42,561 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:42,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0610c88c to 127.0.0.1:64475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:42,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78b3cd51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:42,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:42,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 18:01:42,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:42,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/data/master/store-tmp 2023-02-17 18:01:42,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:42,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:42,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:42,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:42,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:42,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:42,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:42,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:42,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/WALs/jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:42,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35453%2C1676656902397, suffix=, logDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/WALs/jenkins-hbase4.apache.org,35453,1676656902397, archiveDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/oldWALs, maxLogs=10 2023-02-17 18:01:42,617 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35669,DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167,DISK] 2023-02-17 18:01:42,617 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33441,DS-295556e5-8662-4965-8785-1bbb9d341bde,DISK] 2023-02-17 18:01:42,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/WALs/jenkins-hbase4.apache.org,35453,1676656902397/jenkins-hbase4.apache.org%2C35453%2C1676656902397.1676656902602 2023-02-17 18:01:42,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35669,DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167,DISK], DatanodeInfoWithStorage[127.0.0.1:33441,DS-295556e5-8662-4965-8785-1bbb9d341bde,DISK]] 2023-02-17 18:01:42,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:42,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:42,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:42,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:42,625 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:42,626 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 18:01:42,627 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 18:01:42,627 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:42,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:42,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:42,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:42,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:42,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59864271, jitterRate=-0.10795284807682037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:42,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:42,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 18:01:42,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 18:01:42,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 18:01:42,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 18:01:42,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 18:01:42,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 18:01:42,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 18:01:42,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 18:01:42,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 18:01:42,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 18:01:42,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 18:01:42,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 18:01:42,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 18:01:42,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 18:01:42,649 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:42,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 18:01:42,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 18:01:42,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 18:01:42,651 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:42,651 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:42,651 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:42,651 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:42,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35453,1676656902397, sessionid=0x1006371ea9b0000, setting cluster-up flag (Was=false) 2023-02-17 18:01:42,659 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:42,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 18:01:42,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:42,669 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:42,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 18:01:42,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:42,675 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.hbase-snapshot/.tmp 2023-02-17 18:01:42,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:42,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:42,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:42,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:42,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:42,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 18:01:42,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:42,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676656932688 2023-02-17 18:01:42,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 18:01:42,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 18:01:42,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 18:01:42,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 18:01:42,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 18:01:42,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 18:01:42,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,691 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:42,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 18:01:42,692 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 18:01:42,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 18:01:42,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 18:01:42,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 18:01:42,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 18:01:42,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656902692,5,FailOnTimeoutGroup] 2023-02-17 18:01:42,693 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:42,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656902693,5,FailOnTimeoutGroup] 2023-02-17 18:01:42,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 18:01:42,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,707 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:42,707 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:42,707 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff 2023-02-17 18:01:42,721 INFO [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(952): ClusterId : 67f3d208-e8a7-494e-a00b-db5e31c74d6d 2023-02-17 18:01:42,721 DEBUG [RS:0;jenkins-hbase4:40377] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:42,721 INFO [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(952): ClusterId : 67f3d208-e8a7-494e-a00b-db5e31c74d6d 2023-02-17 18:01:42,721 DEBUG [RS:1;jenkins-hbase4:43317] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:42,723 DEBUG [RS:0;jenkins-hbase4:40377] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:42,723 DEBUG [RS:0;jenkins-hbase4:40377] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:42,724 DEBUG [RS:1;jenkins-hbase4:43317] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:42,724 DEBUG [RS:1;jenkins-hbase4:43317] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:42,724 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:42,728 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:42,729 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/info 2023-02-17 18:01:42,729 DEBUG [RS:1;jenkins-hbase4:43317] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:42,731 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:42,731 DEBUG [RS:1;jenkins-hbase4:43317] zookeeper.ReadOnlyZKClient(139): Connect 0x54d154f0 to 127.0.0.1:64475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:42,732 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:42,732 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:42,733 DEBUG [RS:0;jenkins-hbase4:40377] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:42,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:42,733 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:42,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:42,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:42,735 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/table 2023-02-17 18:01:42,735 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:42,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:42,737 DEBUG [RS:0;jenkins-hbase4:40377] zookeeper.ReadOnlyZKClient(139): Connect 0x36404c9f to 127.0.0.1:64475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:42,738 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740 2023-02-17 18:01:42,739 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740 2023-02-17 18:01:42,741 DEBUG [RS:1;jenkins-hbase4:43317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a16b01a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:42,741 DEBUG [RS:0;jenkins-hbase4:40377] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3887a427, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:42,741 DEBUG [RS:1;jenkins-hbase4:43317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e293f80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:42,742 DEBUG [RS:0;jenkins-hbase4:40377] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cb827ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:42,742 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:42,743 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:42,748 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:42,749 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64093241, jitterRate=-0.04493628442287445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:42,749 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:42,749 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:42,749 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:42,749 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:42,749 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:42,749 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:42,750 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:42,750 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:42,750 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:42,750 DEBUG [RS:1;jenkins-hbase4:43317] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43317 2023-02-17 18:01:42,750 DEBUG [RS:0;jenkins-hbase4:40377] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40377 2023-02-17 18:01:42,750 INFO [RS:1;jenkins-hbase4:43317] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:42,751 INFO [RS:0;jenkins-hbase4:40377] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:42,751 INFO [RS:0;jenkins-hbase4:40377] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:42,750 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 18:01:42,751 DEBUG [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:42,751 INFO [RS:1;jenkins-hbase4:43317] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:42,751 DEBUG [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:42,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 18:01:42,751 INFO [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35453,1676656902397 with isa=jenkins-hbase4.apache.org/172.31.14.131:40377, startcode=1676656902457 2023-02-17 18:01:42,751 INFO [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35453,1676656902397 with isa=jenkins-hbase4.apache.org/172.31.14.131:43317, startcode=1676656902495 2023-02-17 18:01:42,751 DEBUG [RS:0;jenkins-hbase4:40377] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:42,751 DEBUG [RS:1;jenkins-hbase4:43317] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:42,752 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 18:01:42,755 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 18:01:42,794 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42967, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:42,797 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43641, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:42,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35453] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:42,799 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:42,800 DEBUG [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff 2023-02-17 18:01:42,800 DEBUG [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43825 2023-02-17 18:01:42,800 DEBUG [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:42,800 DEBUG [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff 2023-02-17 18:01:42,800 DEBUG [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43825 2023-02-17 18:01:42,800 DEBUG [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:42,802 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:42,806 DEBUG [RS:0;jenkins-hbase4:40377] zookeeper.ZKUtil(162): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:42,806 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43317,1676656902495] 2023-02-17 18:01:42,806 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40377,1676656902457] 2023-02-17 18:01:42,806 WARN [RS:0;jenkins-hbase4:40377] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:42,806 INFO [RS:0;jenkins-hbase4:40377] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:42,806 DEBUG [RS:1;jenkins-hbase4:43317] zookeeper.ZKUtil(162): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:42,807 DEBUG [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/WALs/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:42,807 WARN [RS:1;jenkins-hbase4:43317] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:42,807 INFO [RS:1;jenkins-hbase4:43317] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:42,807 DEBUG [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/WALs/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:42,811 DEBUG [RS:1;jenkins-hbase4:43317] zookeeper.ZKUtil(162): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:42,811 DEBUG [RS:0;jenkins-hbase4:40377] zookeeper.ZKUtil(162): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:42,811 DEBUG [RS:1;jenkins-hbase4:43317] zookeeper.ZKUtil(162): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:42,811 DEBUG [RS:0;jenkins-hbase4:40377] zookeeper.ZKUtil(162): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:42,812 DEBUG [RS:1;jenkins-hbase4:43317] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:42,812 DEBUG [RS:0;jenkins-hbase4:40377] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:42,812 INFO [RS:1;jenkins-hbase4:43317] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:42,812 INFO [RS:0;jenkins-hbase4:40377] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:42,814 INFO [RS:1;jenkins-hbase4:43317] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:42,814 INFO [RS:1;jenkins-hbase4:43317] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:42,814 INFO [RS:1;jenkins-hbase4:43317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,816 INFO [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:42,816 INFO [RS:0;jenkins-hbase4:40377] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:42,817 INFO [RS:0;jenkins-hbase4:40377] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:42,817 INFO [RS:0;jenkins-hbase4:40377] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,817 INFO [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:42,818 INFO [RS:1;jenkins-hbase4:43317] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,818 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,818 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,818 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,818 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,818 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,818 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:42,818 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,819 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,819 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,819 DEBUG [RS:1;jenkins-hbase4:43317] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,820 INFO [RS:0;jenkins-hbase4:40377] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,821 DEBUG [RS:0;jenkins-hbase4:40377] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:42,824 INFO [RS:1;jenkins-hbase4:43317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,824 INFO [RS:1;jenkins-hbase4:43317] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,824 INFO [RS:1;jenkins-hbase4:43317] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,833 INFO [RS:0;jenkins-hbase4:40377] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,833 INFO [RS:0;jenkins-hbase4:40377] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,833 INFO [RS:0;jenkins-hbase4:40377] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,847 INFO [RS:0;jenkins-hbase4:40377] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:42,847 INFO [RS:0;jenkins-hbase4:40377] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40377,1676656902457-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,848 INFO [RS:1;jenkins-hbase4:43317] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:42,848 INFO [RS:1;jenkins-hbase4:43317] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43317,1676656902495-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:42,859 INFO [RS:0;jenkins-hbase4:40377] regionserver.Replication(203): jenkins-hbase4.apache.org,40377,1676656902457 started 2023-02-17 18:01:42,859 INFO [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40377,1676656902457, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40377, sessionid=0x1006371ea9b0001 2023-02-17 18:01:42,859 DEBUG [RS:0;jenkins-hbase4:40377] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:42,859 DEBUG [RS:0;jenkins-hbase4:40377] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:42,859 DEBUG [RS:0;jenkins-hbase4:40377] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40377,1676656902457' 2023-02-17 18:01:42,859 DEBUG [RS:0;jenkins-hbase4:40377] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:42,859 DEBUG [RS:0;jenkins-hbase4:40377] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:42,860 DEBUG [RS:0;jenkins-hbase4:40377] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:42,860 DEBUG [RS:0;jenkins-hbase4:40377] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:42,860 DEBUG [RS:0;jenkins-hbase4:40377] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:42,860 DEBUG [RS:0;jenkins-hbase4:40377] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40377,1676656902457' 2023-02-17 18:01:42,860 DEBUG [RS:0;jenkins-hbase4:40377] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:42,860 DEBUG [RS:0;jenkins-hbase4:40377] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:42,861 DEBUG [RS:0;jenkins-hbase4:40377] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:42,861 INFO [RS:0;jenkins-hbase4:40377] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:42,861 INFO [RS:0;jenkins-hbase4:40377] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:42,870 INFO [RS:1;jenkins-hbase4:43317] regionserver.Replication(203): jenkins-hbase4.apache.org,43317,1676656902495 started 2023-02-17 18:01:42,870 INFO [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43317,1676656902495, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43317, sessionid=0x1006371ea9b0002 2023-02-17 18:01:42,870 DEBUG [RS:1;jenkins-hbase4:43317] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:42,870 DEBUG [RS:1;jenkins-hbase4:43317] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:42,870 DEBUG [RS:1;jenkins-hbase4:43317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43317,1676656902495' 2023-02-17 18:01:42,870 DEBUG [RS:1;jenkins-hbase4:43317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:42,871 DEBUG [RS:1;jenkins-hbase4:43317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:42,871 DEBUG [RS:1;jenkins-hbase4:43317] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:42,871 DEBUG [RS:1;jenkins-hbase4:43317] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:42,871 DEBUG [RS:1;jenkins-hbase4:43317] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:42,871 DEBUG [RS:1;jenkins-hbase4:43317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43317,1676656902495' 2023-02-17 18:01:42,871 DEBUG [RS:1;jenkins-hbase4:43317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:42,871 DEBUG [RS:1;jenkins-hbase4:43317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:42,872 DEBUG [RS:1;jenkins-hbase4:43317] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:42,872 INFO [RS:1;jenkins-hbase4:43317] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:42,872 INFO [RS:1;jenkins-hbase4:43317] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:42,906 DEBUG [jenkins-hbase4:35453] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 18:01:42,906 DEBUG [jenkins-hbase4:35453] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:42,908 DEBUG [jenkins-hbase4:35453] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:42,908 DEBUG [jenkins-hbase4:35453] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:42,908 DEBUG [jenkins-hbase4:35453] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:42,910 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40377,1676656902457, state=OPENING 2023-02-17 18:01:42,911 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 18:01:42,912 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:42,913 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:42,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:43,068 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:43,068 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:43,070 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:43,075 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 18:01:43,075 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:43,077 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40377%2C1676656902457.meta, suffix=.meta, logDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/WALs/jenkins-hbase4.apache.org,40377,1676656902457, archiveDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/oldWALs, maxLogs=32 2023-02-17 18:01:43,096 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33441,DS-295556e5-8662-4965-8785-1bbb9d341bde,DISK] 2023-02-17 18:01:43,096 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35669,DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167,DISK] 2023-02-17 18:01:43,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/WALs/jenkins-hbase4.apache.org,40377,1676656902457/jenkins-hbase4.apache.org%2C40377%2C1676656902457.meta.1676656903077.meta 2023-02-17 18:01:43,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35669,DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167,DISK], DatanodeInfoWithStorage[127.0.0.1:33441,DS-295556e5-8662-4965-8785-1bbb9d341bde,DISK]] 2023-02-17 18:01:43,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:43,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 18:01:43,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 18:01:43,098 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 18:01:43,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 18:01:43,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 18:01:43,098 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 18:01:43,100 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:43,101 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/info 2023-02-17 18:01:43,101 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/info 2023-02-17 18:01:43,101 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:43,101 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:43,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:43,102 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:43,102 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:43,103 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:43,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:43,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:43,104 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/table 2023-02-17 18:01:43,104 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/table 2023-02-17 18:01:43,105 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:43,105 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:43,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740 2023-02-17 18:01:43,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740 2023-02-17 18:01:43,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:43,109 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:43,110 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61766074, jitterRate=-0.07961377501487732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:43,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:43,111 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676656903068 2023-02-17 18:01:43,115 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 18:01:43,116 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 18:01:43,116 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40377,1676656902457, state=OPEN 2023-02-17 18:01:43,117 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 18:01:43,118 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:43,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 18:01:43,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40377,1676656902457 in 205 msec 2023-02-17 18:01:43,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 18:01:43,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 368 msec 2023-02-17 18:01:43,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 441 msec 2023-02-17 18:01:43,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676656903122, completionTime=-1 2023-02-17 18:01:43,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 18:01:43,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 18:01:43,124 DEBUG [hconnection-0x20a1a24b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:43,126 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32908, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:43,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 18:01:43,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676656963127 2023-02-17 18:01:43,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676657023127 2023-02-17 18:01:43,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-17 18:01:43,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35453,1676656902397-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:43,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35453,1676656902397-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:43,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35453,1676656902397-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:43,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35453, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:43,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:43,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 18:01:43,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:43,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 18:01:43,136 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 18:01:43,136 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:43,137 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:43,138 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:43,139 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17 empty. 2023-02-17 18:01:43,139 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:43,139 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 18:01:43,150 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:43,151 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 41d0f939a7e3ba862dd99b53cf8a9a17, NAME => 'hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,159 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,159 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 41d0f939a7e3ba862dd99b53cf8a9a17, disabling compactions & flushes 2023-02-17 18:01:43,159 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:43,159 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:43,159 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. after waiting 0 ms 2023-02-17 18:01:43,160 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:43,160 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:43,160 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 41d0f939a7e3ba862dd99b53cf8a9a17: 2023-02-17 18:01:43,162 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:43,162 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656903162"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903162"}]},"ts":"1676656903162"} 2023-02-17 18:01:43,165 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:43,165 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:43,165 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656903165"}]},"ts":"1676656903165"} 2023-02-17 18:01:43,167 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 18:01:43,169 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:43,170 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:43,170 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:43,170 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:43,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=41d0f939a7e3ba862dd99b53cf8a9a17, ASSIGN}] 2023-02-17 18:01:43,176 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=41d0f939a7e3ba862dd99b53cf8a9a17, ASSIGN 2023-02-17 18:01:43,177 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=41d0f939a7e3ba862dd99b53cf8a9a17, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43317,1676656902495; forceNewPlan=false, retain=false 2023-02-17 18:01:43,327 INFO [jenkins-hbase4:35453] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:43,328 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=41d0f939a7e3ba862dd99b53cf8a9a17, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:43,328 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656903328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903328"}]},"ts":"1676656903328"} 2023-02-17 18:01:43,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 41d0f939a7e3ba862dd99b53cf8a9a17, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:43,483 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:43,483 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:43,484 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:43,488 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:43,489 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43317%2C1676656902495, suffix=, logDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/WALs/jenkins-hbase4.apache.org,43317,1676656902495, archiveDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/oldWALs, maxLogs=32 2023-02-17 18:01:43,504 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35669,DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167,DISK] 2023-02-17 18:01:43,504 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33441,DS-295556e5-8662-4965-8785-1bbb9d341bde,DISK] 2023-02-17 18:01:43,506 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/WALs/jenkins-hbase4.apache.org,43317,1676656902495/jenkins-hbase4.apache.org%2C43317%2C1676656902495.1676656903489 2023-02-17 18:01:43,506 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33441,DS-295556e5-8662-4965-8785-1bbb9d341bde,DISK], DatanodeInfoWithStorage[127.0.0.1:35669,DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167,DISK]] 2023-02-17 18:01:43,506 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 41d0f939a7e3ba862dd99b53cf8a9a17, NAME => 'hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:43,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:43,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:43,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:43,508 INFO [StoreOpener-41d0f939a7e3ba862dd99b53cf8a9a17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:43,509 DEBUG [StoreOpener-41d0f939a7e3ba862dd99b53cf8a9a17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17/info 2023-02-17 18:01:43,509 DEBUG [StoreOpener-41d0f939a7e3ba862dd99b53cf8a9a17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17/info 2023-02-17 18:01:43,509 INFO [StoreOpener-41d0f939a7e3ba862dd99b53cf8a9a17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41d0f939a7e3ba862dd99b53cf8a9a17 columnFamilyName info 2023-02-17 18:01:43,510 INFO [StoreOpener-41d0f939a7e3ba862dd99b53cf8a9a17-1] regionserver.HStore(310): Store=41d0f939a7e3ba862dd99b53cf8a9a17/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:43,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:43,511 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:43,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:43,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:43,515 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 41d0f939a7e3ba862dd99b53cf8a9a17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59809062, jitterRate=-0.10877552628517151}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:43,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 41d0f939a7e3ba862dd99b53cf8a9a17: 2023-02-17 18:01:43,515 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17., pid=6, masterSystemTime=1676656903483 2023-02-17 18:01:43,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:43,521 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:43,521 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=41d0f939a7e3ba862dd99b53cf8a9a17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:43,521 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656903521"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656903521"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656903521"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656903521"}]},"ts":"1676656903521"} 2023-02-17 18:01:43,524 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 18:01:43,524 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 41d0f939a7e3ba862dd99b53cf8a9a17, server=jenkins-hbase4.apache.org,43317,1676656902495 in 193 msec 2023-02-17 18:01:43,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 18:01:43,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=41d0f939a7e3ba862dd99b53cf8a9a17, ASSIGN in 354 msec 2023-02-17 18:01:43,526 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:43,526 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656903526"}]},"ts":"1676656903526"} 2023-02-17 18:01:43,527 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 18:01:43,531 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:43,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 397 msec 2023-02-17 18:01:43,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 18:01:43,537 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:43,537 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:43,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:43,540 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:43,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 18:01:43,550 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:43,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-17 18:01:43,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 18:01:43,573 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:43,575 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-17 18:01:43,589 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 18:01:43,593 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 18:01:43,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.064sec 2023-02-17 18:01:43,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 18:01:43,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 18:01:43,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 18:01:43,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35453,1676656902397-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 18:01:43,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35453,1676656902397-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 18:01:43,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 18:01:43,622 DEBUG [Listener at localhost/34907] zookeeper.ReadOnlyZKClient(139): Connect 0x258dc021 to 127.0.0.1:64475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:43,627 DEBUG [Listener at localhost/34907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a0f6f60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:43,636 DEBUG [hconnection-0x11a49a73-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:43,638 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44354, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:43,640 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:43,640 DEBUG [Listener at localhost/34907] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 18:01:43,642 DEBUG [Listener at localhost/34907] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 18:01:43,644 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37348, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 18:01:43,644 INFO [Listener at localhost/34907] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-17 18:01:43,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-17 18:01:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 18:01:43,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 93 connection: 172.31.14.131:37348 deadline: 1676656963644, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-17 18:01:43,645 INFO [Listener at localhost/34907] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-17 18:01:43,647 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:43,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:43,650 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:43,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-17 18:01:43,651 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:43,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:43,658 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:43,658 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:43,658 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:43,658 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:43,658 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:43,658 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:43,658 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:43,658 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:43,659 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1 empty. 2023-02-17 18:01:43,659 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc empty. 2023-02-17 18:01:43,659 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83 empty. 2023-02-17 18:01:43,659 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91 empty. 2023-02-17 18:01:43,659 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa empty. 2023-02-17 18:01:43,659 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422 empty. 2023-02-17 18:01:43,659 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:43,659 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:43,659 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8 empty. 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607 empty. 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6 empty. 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:43,660 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:43,661 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:43,661 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373 empty. 2023-02-17 18:01:43,661 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:43,661 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-17 18:01:43,675 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:43,676 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => a5821f8d4d4b563b416976e7cac4c5c1, NAME => 'testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,676 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 97e3bb502cfdc46374faac1936b51422, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,676 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 288a300782b44ac82fa24ad0dbc7d7f8, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,688 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,688 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 288a300782b44ac82fa24ad0dbc7d7f8, disabling compactions & flushes 2023-02-17 18:01:43,688 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:43,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:43,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. after waiting 0 ms 2023-02-17 18:01:43,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:43,689 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:43,689 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 288a300782b44ac82fa24ad0dbc7d7f8: 2023-02-17 18:01:43,689 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 952edab40cfee0885d2a7504c18c0baa, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,692 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,692 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 97e3bb502cfdc46374faac1936b51422, disabling compactions & flushes 2023-02-17 18:01:43,692 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:43,692 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:43,692 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. after waiting 0 ms 2023-02-17 18:01:43,692 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:43,692 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:43,692 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 97e3bb502cfdc46374faac1936b51422: 2023-02-17 18:01:43,693 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6ae3ca2c1acd14792eb5295cd5402e83, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,700 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,700 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing a5821f8d4d4b563b416976e7cac4c5c1, disabling compactions & flushes 2023-02-17 18:01:43,700 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:43,700 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:43,700 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. after waiting 0 ms 2023-02-17 18:01:43,700 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:43,700 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:43,700 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for a5821f8d4d4b563b416976e7cac4c5c1: 2023-02-17 18:01:43,701 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 87ac265a19634ca6fe96a4aabe2d8607, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,703 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,703 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 952edab40cfee0885d2a7504c18c0baa, disabling compactions & flushes 2023-02-17 18:01:43,703 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:43,703 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:43,703 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. after waiting 0 ms 2023-02-17 18:01:43,703 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:43,703 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:43,703 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 952edab40cfee0885d2a7504c18c0baa: 2023-02-17 18:01:43,704 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => d7518835bdc62d8a5afef2b993a037dc, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,708 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,708 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 6ae3ca2c1acd14792eb5295cd5402e83, disabling compactions & flushes 2023-02-17 18:01:43,708 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:43,708 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:43,708 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. after waiting 0 ms 2023-02-17 18:01:43,708 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:43,708 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:43,708 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 6ae3ca2c1acd14792eb5295cd5402e83: 2023-02-17 18:01:43,708 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3eb86a4406fc57484a9d5a7ea1f24c91, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,711 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,711 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 87ac265a19634ca6fe96a4aabe2d8607, disabling compactions & flushes 2023-02-17 18:01:43,711 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:43,712 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:43,712 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. after waiting 0 ms 2023-02-17 18:01:43,712 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:43,712 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:43,712 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 87ac265a19634ca6fe96a4aabe2d8607: 2023-02-17 18:01:43,712 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4fd0627db9cbe09e51eb5748fc382373, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,716 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,716 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing d7518835bdc62d8a5afef2b993a037dc, disabling compactions & flushes 2023-02-17 18:01:43,716 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:43,716 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:43,716 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. after waiting 0 ms 2023-02-17 18:01:43,716 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:43,716 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:43,716 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for d7518835bdc62d8a5afef2b993a037dc: 2023-02-17 18:01:43,717 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1ecdb84e325d1a1f1bf4c4fde38c5ae6, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp 2023-02-17 18:01:43,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 3eb86a4406fc57484a9d5a7ea1f24c91, disabling compactions & flushes 2023-02-17 18:01:43,720 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:43,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:43,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. after waiting 0 ms 2023-02-17 18:01:43,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:43,720 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:43,720 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 3eb86a4406fc57484a9d5a7ea1f24c91: 2023-02-17 18:01:43,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 4fd0627db9cbe09e51eb5748fc382373, disabling compactions & flushes 2023-02-17 18:01:43,724 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:43,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:43,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. after waiting 0 ms 2023-02-17 18:01:43,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:43,724 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:43,724 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 4fd0627db9cbe09e51eb5748fc382373: 2023-02-17 18:01:43,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:43,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 1ecdb84e325d1a1f1bf4c4fde38c5ae6, disabling compactions & flushes 2023-02-17 18:01:43,726 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:43,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:43,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. after waiting 0 ms 2023-02-17 18:01:43,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:43,726 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:43,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 1ecdb84e325d1a1f1bf4c4fde38c5ae6: 2023-02-17 18:01:43,728 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:43,729 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,729 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,729 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,729 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,729 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,729 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,729 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656903729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656903729"}]},"ts":"1676656903729"} 2023-02-17 18:01:43,732 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-17 18:01:43,733 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:43,733 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656903733"}]},"ts":"1676656903733"} 2023-02-17 18:01:43,734 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-17 18:01:43,738 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:43,745 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:43,745 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:43,745 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:43,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5821f8d4d4b563b416976e7cac4c5c1, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=97e3bb502cfdc46374faac1936b51422, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=288a300782b44ac82fa24ad0dbc7d7f8, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=952edab40cfee0885d2a7504c18c0baa, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6ae3ca2c1acd14792eb5295cd5402e83, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac265a19634ca6fe96a4aabe2d8607, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7518835bdc62d8a5afef2b993a037dc, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3eb86a4406fc57484a9d5a7ea1f24c91, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4fd0627db9cbe09e51eb5748fc382373, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ecdb84e325d1a1f1bf4c4fde38c5ae6, ASSIGN}] 2023-02-17 18:01:43,748 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=97e3bb502cfdc46374faac1936b51422, ASSIGN 2023-02-17 18:01:43,748 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5821f8d4d4b563b416976e7cac4c5c1, ASSIGN 2023-02-17 18:01:43,748 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=288a300782b44ac82fa24ad0dbc7d7f8, ASSIGN 2023-02-17 18:01:43,748 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=952edab40cfee0885d2a7504c18c0baa, ASSIGN 2023-02-17 18:01:43,749 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=97e3bb502cfdc46374faac1936b51422, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43317,1676656902495; forceNewPlan=false, retain=false 2023-02-17 18:01:43,749 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5821f8d4d4b563b416976e7cac4c5c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40377,1676656902457; forceNewPlan=false, retain=false 2023-02-17 18:01:43,749 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=288a300782b44ac82fa24ad0dbc7d7f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40377,1676656902457; forceNewPlan=false, retain=false 2023-02-17 18:01:43,749 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=952edab40cfee0885d2a7504c18c0baa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43317,1676656902495; forceNewPlan=false, retain=false 2023-02-17 18:01:43,751 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ecdb84e325d1a1f1bf4c4fde38c5ae6, ASSIGN 2023-02-17 18:01:43,751 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4fd0627db9cbe09e51eb5748fc382373, ASSIGN 2023-02-17 18:01:43,751 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3eb86a4406fc57484a9d5a7ea1f24c91, ASSIGN 2023-02-17 18:01:43,751 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7518835bdc62d8a5afef2b993a037dc, ASSIGN 2023-02-17 18:01:43,752 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac265a19634ca6fe96a4aabe2d8607, ASSIGN 2023-02-17 18:01:43,752 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ecdb84e325d1a1f1bf4c4fde38c5ae6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43317,1676656902495; forceNewPlan=false, retain=false 2023-02-17 18:01:43,752 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4fd0627db9cbe09e51eb5748fc382373, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40377,1676656902457; forceNewPlan=false, retain=false 2023-02-17 18:01:43,752 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3eb86a4406fc57484a9d5a7ea1f24c91, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43317,1676656902495; forceNewPlan=false, retain=false 2023-02-17 18:01:43,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:43,753 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7518835bdc62d8a5afef2b993a037dc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40377,1676656902457; forceNewPlan=false, retain=false 2023-02-17 18:01:43,753 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac265a19634ca6fe96a4aabe2d8607, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43317,1676656902495; forceNewPlan=false, retain=false 2023-02-17 18:01:43,753 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6ae3ca2c1acd14792eb5295cd5402e83, ASSIGN 2023-02-17 18:01:43,765 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6ae3ca2c1acd14792eb5295cd5402e83, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40377,1676656902457; forceNewPlan=false, retain=false 2023-02-17 18:01:43,863 INFO [RS:0;jenkins-hbase4:40377] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40377%2C1676656902457, suffix=, logDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/WALs/jenkins-hbase4.apache.org,40377,1676656902457, archiveDir=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/oldWALs, maxLogs=32 2023-02-17 18:01:43,879 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35669,DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167,DISK] 2023-02-17 18:01:43,880 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33441,DS-295556e5-8662-4965-8785-1bbb9d341bde,DISK] 2023-02-17 18:01:43,888 INFO [RS:0;jenkins-hbase4:40377] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/WALs/jenkins-hbase4.apache.org,40377,1676656902457/jenkins-hbase4.apache.org%2C40377%2C1676656902457.1676656903863 2023-02-17 18:01:43,890 DEBUG [RS:0;jenkins-hbase4:40377] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35669,DS-bcf5c637-adb1-40ed-bfe4-0ed33b2de167,DISK], DatanodeInfoWithStorage[127.0.0.1:33441,DS-295556e5-8662-4965-8785-1bbb9d341bde,DISK]] 2023-02-17 18:01:43,899 INFO [jenkins-hbase4:35453] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-17 18:01:43,907 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=87ac265a19634ca6fe96a4aabe2d8607, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:43,907 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=952edab40cfee0885d2a7504c18c0baa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:43,907 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3eb86a4406fc57484a9d5a7ea1f24c91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:43,907 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903907"}]},"ts":"1676656903907"} 2023-02-17 18:01:43,907 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=97e3bb502cfdc46374faac1936b51422, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:43,907 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1ecdb84e325d1a1f1bf4c4fde38c5ae6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:43,907 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903907"}]},"ts":"1676656903907"} 2023-02-17 18:01:43,907 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903907"}]},"ts":"1676656903907"} 2023-02-17 18:01:43,907 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903907"}]},"ts":"1676656903907"} 2023-02-17 18:01:43,907 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656903907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903907"}]},"ts":"1676656903907"} 2023-02-17 18:01:43,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 952edab40cfee0885d2a7504c18c0baa, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:43,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 97e3bb502cfdc46374faac1936b51422, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:43,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure 3eb86a4406fc57484a9d5a7ea1f24c91, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:43,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 87ac265a19634ca6fe96a4aabe2d8607, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:43,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 1ecdb84e325d1a1f1bf4c4fde38c5ae6, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:43,912 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=288a300782b44ac82fa24ad0dbc7d7f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:43,912 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903912"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903912"}]},"ts":"1676656903912"} 2023-02-17 18:01:43,912 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4fd0627db9cbe09e51eb5748fc382373, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:43,912 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903912"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903912"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903912"}]},"ts":"1676656903912"} 2023-02-17 18:01:43,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 288a300782b44ac82fa24ad0dbc7d7f8, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:43,914 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d7518835bdc62d8a5afef2b993a037dc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:43,914 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6ae3ca2c1acd14792eb5295cd5402e83, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:43,914 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903914"}]},"ts":"1676656903914"} 2023-02-17 18:01:43,914 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656903914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903914"}]},"ts":"1676656903914"} 2023-02-17 18:01:43,915 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure 4fd0627db9cbe09e51eb5748fc382373, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:43,916 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a5821f8d4d4b563b416976e7cac4c5c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:43,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure d7518835bdc62d8a5afef2b993a037dc, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:43,917 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656903916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656903916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656903916"}]},"ts":"1676656903916"} 2023-02-17 18:01:43,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure 6ae3ca2c1acd14792eb5295cd5402e83, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:43,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure a5821f8d4d4b563b416976e7cac4c5c1, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:43,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:44,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:44,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3eb86a4406fc57484a9d5a7ea1f24c91, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-17 18:01:44,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:44,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:44,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:44,065 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:44,067 DEBUG [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1 2023-02-17 18:01:44,067 DEBUG [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1 2023-02-17 18:01:44,067 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eb86a4406fc57484a9d5a7ea1f24c91 columnFamilyName f1 2023-02-17 18:01:44,068 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(310): Store=3eb86a4406fc57484a9d5a7ea1f24c91/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,068 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:44,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:44,070 DEBUG [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2 2023-02-17 18:01:44,070 DEBUG [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2 2023-02-17 18:01:44,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6ae3ca2c1acd14792eb5295cd5402e83, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-17 18:01:44,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:44,070 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eb86a4406fc57484a9d5a7ea1f24c91 columnFamilyName f2 2023-02-17 18:01:44,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:44,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:44,071 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(310): Store=3eb86a4406fc57484a9d5a7ea1f24c91/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:44,071 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:44,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:44,073 DEBUG [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1 2023-02-17 18:01:44,073 DEBUG [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1 2023-02-17 18:01:44,073 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ae3ca2c1acd14792eb5295cd5402e83 columnFamilyName f1 2023-02-17 18:01:44,073 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(310): Store=6ae3ca2c1acd14792eb5295cd5402e83/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,073 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:44,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,075 DEBUG [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2 2023-02-17 18:01:44,075 DEBUG [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2 2023-02-17 18:01:44,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:44,075 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ae3ca2c1acd14792eb5295cd5402e83 columnFamilyName f2 2023-02-17 18:01:44,075 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(310): Store=6ae3ca2c1acd14792eb5295cd5402e83/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:44,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:44,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3eb86a4406fc57484a9d5a7ea1f24c91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73829954, jitterRate=0.10015204548835754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3eb86a4406fc57484a9d5a7ea1f24c91: 2023-02-17 18:01:44,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91., pid=23, masterSystemTime=1676656904060 2023-02-17 18:01:44,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:44,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:44,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:44,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 97e3bb502cfdc46374faac1936b51422, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-17 18:01:44,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:44,080 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3eb86a4406fc57484a9d5a7ea1f24c91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:44,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,080 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656904080"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904080"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904080"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904080"}]},"ts":"1676656904080"} 2023-02-17 18:01:44,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:44,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:44,081 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:44,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,082 DEBUG [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1 2023-02-17 18:01:44,082 DEBUG [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1 2023-02-17 18:01:44,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6ae3ca2c1acd14792eb5295cd5402e83; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65346118, jitterRate=-0.02626696228981018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6ae3ca2c1acd14792eb5295cd5402e83: 2023-02-17 18:01:44,082 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97e3bb502cfdc46374faac1936b51422 columnFamilyName f1 2023-02-17 18:01:44,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-17 18:01:44,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure 3eb86a4406fc57484a9d5a7ea1f24c91, server=jenkins-hbase4.apache.org,43317,1676656902495 in 171 msec 2023-02-17 18:01:44,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83., pid=29, masterSystemTime=1676656904066 2023-02-17 18:01:44,083 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(310): Store=97e3bb502cfdc46374faac1936b51422/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,083 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:44,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3eb86a4406fc57484a9d5a7ea1f24c91, ASSIGN in 338 msec 2023-02-17 18:01:44,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:44,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:44,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:44,084 DEBUG [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2 2023-02-17 18:01:44,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4fd0627db9cbe09e51eb5748fc382373, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-17 18:01:44,084 DEBUG [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2 2023-02-17 18:01:44,085 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6ae3ca2c1acd14792eb5295cd5402e83, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:44,085 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656904084"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904084"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904084"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904084"}]},"ts":"1676656904084"} 2023-02-17 18:01:44,085 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97e3bb502cfdc46374faac1936b51422 columnFamilyName f2 2023-02-17 18:01:44,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:44,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:44,085 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(310): Store=97e3bb502cfdc46374faac1936b51422/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,086 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:44,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:44,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:44,087 DEBUG [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1 2023-02-17 18:01:44,087 DEBUG [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1 2023-02-17 18:01:44,087 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fd0627db9cbe09e51eb5748fc382373 columnFamilyName f1 2023-02-17 18:01:44,087 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(310): Store=4fd0627db9cbe09e51eb5748fc382373/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,088 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:44,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,089 DEBUG [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2 2023-02-17 18:01:44,089 DEBUG [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2 2023-02-17 18:01:44,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:44,089 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fd0627db9cbe09e51eb5748fc382373 columnFamilyName f2 2023-02-17 18:01:44,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-17 18:01:44,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure 6ae3ca2c1acd14792eb5295cd5402e83, server=jenkins-hbase4.apache.org,40377,1676656902457 in 171 msec 2023-02-17 18:01:44,090 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(310): Store=4fd0627db9cbe09e51eb5748fc382373/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6ae3ca2c1acd14792eb5295cd5402e83, ASSIGN in 344 msec 2023-02-17 18:01:44,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:44,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:44,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 97e3bb502cfdc46374faac1936b51422; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69596720, jitterRate=0.037071943283081055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 97e3bb502cfdc46374faac1936b51422: 2023-02-17 18:01:44,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422., pid=22, masterSystemTime=1676656904060 2023-02-17 18:01:44,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:44,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:44,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:44,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 952edab40cfee0885d2a7504c18c0baa, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-17 18:01:44,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:44,094 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=97e3bb502cfdc46374faac1936b51422, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:44,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,095 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656904094"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904094"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904094"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904094"}]},"ts":"1676656904094"} 2023-02-17 18:01:44,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:44,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:44,096 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:44,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4fd0627db9cbe09e51eb5748fc382373; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60656821, jitterRate=-0.09614293277263641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4fd0627db9cbe09e51eb5748fc382373: 2023-02-17 18:01:44,097 DEBUG [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1 2023-02-17 18:01:44,097 DEBUG [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1 2023-02-17 18:01:44,098 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 952edab40cfee0885d2a7504c18c0baa columnFamilyName f1 2023-02-17 18:01:44,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-17 18:01:44,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373., pid=27, masterSystemTime=1676656904066 2023-02-17 18:01:44,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 97e3bb502cfdc46374faac1936b51422, server=jenkins-hbase4.apache.org,43317,1676656902495 in 187 msec 2023-02-17 18:01:44,098 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(310): Store=952edab40cfee0885d2a7504c18c0baa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,098 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:44,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=97e3bb502cfdc46374faac1936b51422, ASSIGN in 353 msec 2023-02-17 18:01:44,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:44,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:44,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:44,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a5821f8d4d4b563b416976e7cac4c5c1, NAME => 'testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-17 18:01:44,100 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4fd0627db9cbe09e51eb5748fc382373, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:44,100 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656904100"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904100"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904100"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904100"}]},"ts":"1676656904100"} 2023-02-17 18:01:44,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:44,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:44,101 DEBUG [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2 2023-02-17 18:01:44,101 DEBUG [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2 2023-02-17 18:01:44,101 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 952edab40cfee0885d2a7504c18c0baa columnFamilyName f2 2023-02-17 18:01:44,101 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:44,102 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(310): Store=952edab40cfee0885d2a7504c18c0baa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:44,103 DEBUG [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/f1 2023-02-17 18:01:44,103 DEBUG [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/f1 2023-02-17 18:01:44,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:44,103 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5821f8d4d4b563b416976e7cac4c5c1 columnFamilyName f1 2023-02-17 18:01:44,103 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] regionserver.HStore(310): Store=a5821f8d4d4b563b416976e7cac4c5c1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,103 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:44,105 DEBUG [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/f2 2023-02-17 18:01:44,105 DEBUG [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/f2 2023-02-17 18:01:44,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,105 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5821f8d4d4b563b416976e7cac4c5c1 columnFamilyName f2 2023-02-17 18:01:44,105 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] regionserver.HStore(310): Store=a5821f8d4d4b563b416976e7cac4c5c1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:44,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:44,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:44,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-17 18:01:44,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure 4fd0627db9cbe09e51eb5748fc382373, server=jenkins-hbase4.apache.org,40377,1676656902457 in 186 msec 2023-02-17 18:01:44,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 952edab40cfee0885d2a7504c18c0baa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62211146, jitterRate=-0.07298168540000916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 952edab40cfee0885d2a7504c18c0baa: 2023-02-17 18:01:44,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4fd0627db9cbe09e51eb5748fc382373, ASSIGN in 363 msec 2023-02-17 18:01:44,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa., pid=21, masterSystemTime=1676656904060 2023-02-17 18:01:44,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:44,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:44,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:44,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:44,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 87ac265a19634ca6fe96a4aabe2d8607, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-17 18:01:44,111 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=952edab40cfee0885d2a7504c18c0baa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:44,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656904111"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904111"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904111"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904111"}]},"ts":"1676656904111"} 2023-02-17 18:01:44,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:44,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:44,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a5821f8d4d4b563b416976e7cac4c5c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68754962, jitterRate=0.02452877163887024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a5821f8d4d4b563b416976e7cac4c5c1: 2023-02-17 18:01:44,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1., pid=30, masterSystemTime=1676656904066 2023-02-17 18:01:44,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-17 18:01:44,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 952edab40cfee0885d2a7504c18c0baa, server=jenkins-hbase4.apache.org,43317,1676656902495 in 204 msec 2023-02-17 18:01:44,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:44,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:44,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:44,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d7518835bdc62d8a5afef2b993a037dc, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-17 18:01:44,115 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=a5821f8d4d4b563b416976e7cac4c5c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:44,116 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656904115"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904115"}]},"ts":"1676656904115"} 2023-02-17 18:01:44,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=952edab40cfee0885d2a7504c18c0baa, ASSIGN in 369 msec 2023-02-17 18:01:44,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:44,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:44,118 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:44,118 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:44,119 DEBUG [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1 2023-02-17 18:01:44,119 DEBUG [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1 2023-02-17 18:01:44,120 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7518835bdc62d8a5afef2b993a037dc columnFamilyName f1 2023-02-17 18:01:44,120 DEBUG [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1 2023-02-17 18:01:44,120 DEBUG [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1 2023-02-17 18:01:44,120 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(310): Store=d7518835bdc62d8a5afef2b993a037dc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,120 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:44,120 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ac265a19634ca6fe96a4aabe2d8607 columnFamilyName f1 2023-02-17 18:01:44,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-17 18:01:44,121 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure a5821f8d4d4b563b416976e7cac4c5c1, server=jenkins-hbase4.apache.org,40377,1676656902457 in 199 msec 2023-02-17 18:01:44,121 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(310): Store=87ac265a19634ca6fe96a4aabe2d8607/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,121 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:44,122 DEBUG [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2 2023-02-17 18:01:44,122 DEBUG [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2 2023-02-17 18:01:44,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5821f8d4d4b563b416976e7cac4c5c1, ASSIGN in 376 msec 2023-02-17 18:01:44,122 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7518835bdc62d8a5afef2b993a037dc columnFamilyName f2 2023-02-17 18:01:44,123 DEBUG [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2 2023-02-17 18:01:44,123 DEBUG [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2 2023-02-17 18:01:44,123 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(310): Store=d7518835bdc62d8a5afef2b993a037dc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,123 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ac265a19634ca6fe96a4aabe2d8607 columnFamilyName f2 2023-02-17 18:01:44,123 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(310): Store=87ac265a19634ca6fe96a4aabe2d8607/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:44,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:44,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:44,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:44,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:44,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d7518835bdc62d8a5afef2b993a037dc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69815055, jitterRate=0.04032538831233978}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d7518835bdc62d8a5afef2b993a037dc: 2023-02-17 18:01:44,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc., pid=28, masterSystemTime=1676656904066 2023-02-17 18:01:44,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:44,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:44,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:44,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:44,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 288a300782b44ac82fa24ad0dbc7d7f8, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-17 18:01:44,133 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d7518835bdc62d8a5afef2b993a037dc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:44,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:44,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:44,133 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656904132"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904132"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904132"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904132"}]},"ts":"1676656904132"} 2023-02-17 18:01:44,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 87ac265a19634ca6fe96a4aabe2d8607; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58868920, jitterRate=-0.12278473377227783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 87ac265a19634ca6fe96a4aabe2d8607: 2023-02-17 18:01:44,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607., pid=24, masterSystemTime=1676656904060 2023-02-17 18:01:44,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-17 18:01:44,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure d7518835bdc62d8a5afef2b993a037dc, server=jenkins-hbase4.apache.org,40377,1676656902457 in 218 msec 2023-02-17 18:01:44,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:44,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:44,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:44,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1ecdb84e325d1a1f1bf4c4fde38c5ae6, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-17 18:01:44,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7518835bdc62d8a5afef2b993a037dc, ASSIGN in 391 msec 2023-02-17 18:01:44,137 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=87ac265a19634ca6fe96a4aabe2d8607, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:44,137 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656904137"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904137"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904137"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904137"}]},"ts":"1676656904137"} 2023-02-17 18:01:44,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:44,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:44,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:44,140 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:44,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-17 18:01:44,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 87ac265a19634ca6fe96a4aabe2d8607, server=jenkins-hbase4.apache.org,43317,1676656902495 in 227 msec 2023-02-17 18:01:44,140 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:44,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac265a19634ca6fe96a4aabe2d8607, ASSIGN in 395 msec 2023-02-17 18:01:44,141 DEBUG [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1 2023-02-17 18:01:44,141 DEBUG [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/f1 2023-02-17 18:01:44,141 DEBUG [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/f1 2023-02-17 18:01:44,141 DEBUG [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1 2023-02-17 18:01:44,142 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ecdb84e325d1a1f1bf4c4fde38c5ae6 columnFamilyName f1 2023-02-17 18:01:44,142 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 288a300782b44ac82fa24ad0dbc7d7f8 columnFamilyName f1 2023-02-17 18:01:44,142 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] regionserver.HStore(310): Store=1ecdb84e325d1a1f1bf4c4fde38c5ae6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,142 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(310): Store=288a300782b44ac82fa24ad0dbc7d7f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,142 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:44,142 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:44,143 DEBUG [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/f2 2023-02-17 18:01:44,143 DEBUG [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/f2 2023-02-17 18:01:44,143 DEBUG [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2 2023-02-17 18:01:44,144 DEBUG [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2 2023-02-17 18:01:44,144 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ecdb84e325d1a1f1bf4c4fde38c5ae6 columnFamilyName f2 2023-02-17 18:01:44,144 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 288a300782b44ac82fa24ad0dbc7d7f8 columnFamilyName f2 2023-02-17 18:01:44,144 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] regionserver.HStore(310): Store=1ecdb84e325d1a1f1bf4c4fde38c5ae6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,144 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(310): Store=288a300782b44ac82fa24ad0dbc7d7f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:44,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:44,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:44,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:44,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:44,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:44,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:44,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:44,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:44,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 288a300782b44ac82fa24ad0dbc7d7f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60051598, jitterRate=-0.10516145825386047}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 288a300782b44ac82fa24ad0dbc7d7f8: 2023-02-17 18:01:44,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1ecdb84e325d1a1f1bf4c4fde38c5ae6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71835297, jitterRate=0.07042934000492096}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:44,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1ecdb84e325d1a1f1bf4c4fde38c5ae6: 2023-02-17 18:01:44,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8., pid=26, masterSystemTime=1676656904066 2023-02-17 18:01:44,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6., pid=25, masterSystemTime=1676656904060 2023-02-17 18:01:44,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:44,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:44,152 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=288a300782b44ac82fa24ad0dbc7d7f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656904152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904152"}]},"ts":"1676656904152"} 2023-02-17 18:01:44,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:44,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:44,153 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=1ecdb84e325d1a1f1bf4c4fde38c5ae6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656904153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656904153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656904153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656904153"}]},"ts":"1676656904153"} 2023-02-17 18:01:44,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-17 18:01:44,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 288a300782b44ac82fa24ad0dbc7d7f8, server=jenkins-hbase4.apache.org,40377,1676656902457 in 240 msec 2023-02-17 18:01:44,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-17 18:01:44,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 1ecdb84e325d1a1f1bf4c4fde38c5ae6, server=jenkins-hbase4.apache.org,43317,1676656902495 in 242 msec 2023-02-17 18:01:44,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=288a300782b44ac82fa24ad0dbc7d7f8, ASSIGN in 410 msec 2023-02-17 18:01:44,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-17 18:01:44,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ecdb84e325d1a1f1bf4c4fde38c5ae6, ASSIGN in 411 msec 2023-02-17 18:01:44,158 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:44,158 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656904158"}]},"ts":"1676656904158"} 2023-02-17 18:01:44,159 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-17 18:01:44,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:44,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 514 msec 2023-02-17 18:01:44,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:44,257 INFO [Listener at localhost/34907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-17 18:01:44,257 DEBUG [Listener at localhost/34907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-17 18:01:44,257 INFO [Listener at localhost/34907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:44,260 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-17 18:01:44,260 INFO [Listener at localhost/34907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:44,260 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-17 18:01:44,260 INFO [Listener at localhost/34907] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 18:01:44,293 DEBUG [hconnection-0x11a49a73-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:44,305 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56052, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:44,312 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40377] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:44,316 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43317] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:44,381 INFO [Listener at localhost/34907] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 18:01:44,381 INFO [Listener at localhost/34907] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 18:01:44,382 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-17 18:01:44,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676656904382 (current time:1676656904382). 2023-02-17 18:01:44,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 18:01:44,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] zookeeper.ReadOnlyZKClient(139): Connect 0x21d19c56 to 127.0.0.1:64475 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:44,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b21d6b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:44,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:44,399 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44360, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:44,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21d19c56 to 127.0.0.1:64475 2023-02-17 18:01:44,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:44,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 18:01:44,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-17 18:01:44,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-17 18:01:44,404 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-17 18:01:44,405 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676657504405 2023-02-17 18:01:44,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-17 18:01:44,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,407 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-17 18:01:44,407 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:44,407 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 18:01:44,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-17 18:01:44,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-17 18:01:44,409 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-17 18:01:44,409 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676657504409 2023-02-17 18:01:44,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,418 INFO [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-17 18:01:44,418 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:44,419 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-17 18:01:44,419 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-17 18:01:44,419 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,419 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,421 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:44,421 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:44,421 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:44,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:44,421 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,421 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,422 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,422 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-17 18:01:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-17 18:01:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-17 18:01:44,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-17 18:01:44,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,427 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-17 18:01:44,428 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:44,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 18:01:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 18:01:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43317,1676656902495' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 18:01:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-17 18:01:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 18:01:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 18:01:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40377,1676656902457' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 18:01:44,433 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,433 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:44,433 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,433 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,434 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:44,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43317,1676656902495' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 18:01:44,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f598167[Count = 1] remaining members to acquire global barrier 2023-02-17 18:01:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:44,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:44,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:44,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40377,1676656902457' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 18:01:44,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f598167[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:44,440 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-17 18:01:44,440 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,441 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,441 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,441 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,441 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 18:01:44,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,442 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,442 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:44,442 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 18:01:44,442 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:44,442 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. started... 2023-02-17 18:01:44,442 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:44,442 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. started... 2023-02-17 18:01:44,449 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a5821f8d4d4b563b416976e7cac4c5c1: 2023-02-17 18:01:44,449 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:44,449 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 288a300782b44ac82fa24ad0dbc7d7f8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:44,449 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,449 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 18:01:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:01:44,449 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. started... 2023-02-17 18:01:44,449 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:44,450 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. started... 2023-02-17 18:01:44,452 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,452 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-17 18:01:44,452 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:44,452 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 952edab40cfee0885d2a7504c18c0baa 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:44,452 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:44,452 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6ae3ca2c1acd14792eb5295cd5402e83 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:44,452 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. started... 2023-02-17 18:01:44,452 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. started... 2023-02-17 18:01:44,452 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:01:44,452 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:44,454 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1ecdb84e325d1a1f1bf4c4fde38c5ae6: 2023-02-17 18:01:44,453 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 87ac265a19634ca6fe96a4aabe2d8607 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:44,454 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,454 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:44,455 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,455 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:44,455 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-17 18:01:44,493 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. completed. 2023-02-17 18:01:44,493 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:44,493 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/.tmp/f1/c1f9727f871b4573888f4ec7092ef51a 2023-02-17 18:01:44,493 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 18:01:44,493 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:44,493 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. started... 2023-02-17 18:01:44,496 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 97e3bb502cfdc46374faac1936b51422 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 18:01:44,498 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. completed. 2023-02-17 18:01:44,498 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:44,498 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:44,498 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-17 18:01:44,498 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. started... 2023-02-17 18:01:44,499 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4fd0627db9cbe09e51eb5748fc382373 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-17 18:01:44,508 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:44,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 18:01:44,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:44,509 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 18:01:44,514 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/.tmp/f1/45d0e1f7a71746e68417205dd2635d76 2023-02-17 18:01:44,514 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 18:01:44,521 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/.tmp/f1/332f4f44c7ff4f33aa29c82bbd42bb11 2023-02-17 18:01:44,532 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/.tmp/f1/68f9d9d397d94a8da1de7fed44539402 2023-02-17 18:01:44,532 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/.tmp/f1/5d91c349fc524669a80fb50ecff26ff5 2023-02-17 18:01:44,566 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/.tmp/f2/0664d4ba5bed4f439724cef0f02d880d 2023-02-17 18:01:44,576 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/.tmp/f2/3b31ab632b2d4758b15624fdaa92140b 2023-02-17 18:01:44,576 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/.tmp/f2/17194578853e49e18e08875cb34aaedc 2023-02-17 18:01:44,581 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/.tmp/f1/45d0e1f7a71746e68417205dd2635d76 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/45d0e1f7a71746e68417205dd2635d76 2023-02-17 18:01:44,585 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/45d0e1f7a71746e68417205dd2635d76, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,586 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/.tmp/f2/0664d4ba5bed4f439724cef0f02d880d as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/0664d4ba5bed4f439724cef0f02d880d 2023-02-17 18:01:44,589 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/.tmp/f1/332f4f44c7ff4f33aa29c82bbd42bb11 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/332f4f44c7ff4f33aa29c82bbd42bb11 2023-02-17 18:01:44,591 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/.tmp/f1/68f9d9d397d94a8da1de7fed44539402 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/68f9d9d397d94a8da1de7fed44539402 2023-02-17 18:01:44,594 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/332f4f44c7ff4f33aa29c82bbd42bb11, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,595 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/.tmp/f2/17194578853e49e18e08875cb34aaedc as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/17194578853e49e18e08875cb34aaedc 2023-02-17 18:01:44,595 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/.tmp/f2/dd5fd05f760343c482c9318351fa5c44 2023-02-17 18:01:44,596 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/68f9d9d397d94a8da1de7fed44539402, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,597 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/.tmp/f2/3b31ab632b2d4758b15624fdaa92140b as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/3b31ab632b2d4758b15624fdaa92140b 2023-02-17 18:01:44,597 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/0664d4ba5bed4f439724cef0f02d880d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,599 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6ae3ca2c1acd14792eb5295cd5402e83 in 147ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:44,599 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-17 18:01:44,600 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6ae3ca2c1acd14792eb5295cd5402e83: 2023-02-17 18:01:44,600 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,600 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,600 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/45d0e1f7a71746e68417205dd2635d76] hfiles 2023-02-17 18:01:44,600 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/45d0e1f7a71746e68417205dd2635d76 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,600 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/0664d4ba5bed4f439724cef0f02d880d] hfiles 2023-02-17 18:01:44,600 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/0664d4ba5bed4f439724cef0f02d880d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,602 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/17194578853e49e18e08875cb34aaedc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,602 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 288a300782b44ac82fa24ad0dbc7d7f8 in 153ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:44,603 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/3b31ab632b2d4758b15624fdaa92140b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,603 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/.tmp/f1/5d91c349fc524669a80fb50ecff26ff5 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/5d91c349fc524669a80fb50ecff26ff5 2023-02-17 18:01:44,604 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 87ac265a19634ca6fe96a4aabe2d8607 in 151ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 87ac265a19634ca6fe96a4aabe2d8607: 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 288a300782b44ac82fa24ad0dbc7d7f8: 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/68f9d9d397d94a8da1de7fed44539402] hfiles 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/68f9d9d397d94a8da1de7fed44539402 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/3b31ab632b2d4758b15624fdaa92140b] hfiles 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/332f4f44c7ff4f33aa29c82bbd42bb11] hfiles 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/332f4f44c7ff4f33aa29c82bbd42bb11 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,605 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/3b31ab632b2d4758b15624fdaa92140b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,606 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/17194578853e49e18e08875cb34aaedc] hfiles 2023-02-17 18:01:44,606 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/17194578853e49e18e08875cb34aaedc for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,621 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. completed. 2023-02-17 18:01:44,621 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:44,621 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:44,621 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 18:01:44,621 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. started... 2023-02-17 18:01:44,622 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/5d91c349fc524669a80fb50ecff26ff5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:44,623 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d7518835bdc62d8a5afef2b993a037dc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:44,624 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/.tmp/f2/dd5fd05f760343c482c9318351fa5c44 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/dd5fd05f760343c482c9318351fa5c44 2023-02-17 18:01:44,629 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. completed. 2023-02-17 18:01:44,629 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:44,629 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 18:01:44,631 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/dd5fd05f760343c482c9318351fa5c44, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:44,632 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 97e3bb502cfdc46374faac1936b51422 in 136ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:44,632 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. completed. 2023-02-17 18:01:44,632 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:44,632 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 97e3bb502cfdc46374faac1936b51422: 2023-02-17 18:01:44,632 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-17 18:01:44,632 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:44,632 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,632 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. started... 2023-02-17 18:01:44,632 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,632 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/5d91c349fc524669a80fb50ecff26ff5] hfiles 2023-02-17 18:01:44,633 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/5d91c349fc524669a80fb50ecff26ff5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,633 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/dd5fd05f760343c482c9318351fa5c44] hfiles 2023-02-17 18:01:44,633 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/dd5fd05f760343c482c9318351fa5c44 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,633 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3eb86a4406fc57484a9d5a7ea1f24c91 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-17 18:01:44,655 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. completed. 2023-02-17 18:01:44,655 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:44,655 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-17 18:01:44,655 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/.tmp/f1/c873bd1a80184f65a0f1c536e5105a16 2023-02-17 18:01:44,659 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/.tmp/f1/53a6adef23a9493bb6de7ac504649193 2023-02-17 18:01:44,672 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/.tmp/f2/953c76ab50784139a131e0c2ba4a965b 2023-02-17 18:01:44,676 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/.tmp/f1/c873bd1a80184f65a0f1c536e5105a16 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/c873bd1a80184f65a0f1c536e5105a16 2023-02-17 18:01:44,681 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/c873bd1a80184f65a0f1c536e5105a16, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,682 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/.tmp/f2/1dbee9dae9764128ac2ab2f98edc0c08 2023-02-17 18:01:44,682 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/.tmp/f2/953c76ab50784139a131e0c2ba4a965b as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/953c76ab50784139a131e0c2ba4a965b 2023-02-17 18:01:44,686 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/.tmp/f1/53a6adef23a9493bb6de7ac504649193 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/53a6adef23a9493bb6de7ac504649193 2023-02-17 18:01:44,686 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/953c76ab50784139a131e0c2ba4a965b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,687 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d7518835bdc62d8a5afef2b993a037dc in 64ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:44,687 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d7518835bdc62d8a5afef2b993a037dc: 2023-02-17 18:01:44,687 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,687 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,687 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/c873bd1a80184f65a0f1c536e5105a16] hfiles 2023-02-17 18:01:44,687 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/c873bd1a80184f65a0f1c536e5105a16 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,687 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/953c76ab50784139a131e0c2ba4a965b] hfiles 2023-02-17 18:01:44,687 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/953c76ab50784139a131e0c2ba4a965b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,690 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/53a6adef23a9493bb6de7ac504649193, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,691 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/.tmp/f2/1dbee9dae9764128ac2ab2f98edc0c08 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/1dbee9dae9764128ac2ab2f98edc0c08 2023-02-17 18:01:44,693 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. completed. 2023-02-17 18:01:44,693 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:44,693 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 18:01:44,695 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/1dbee9dae9764128ac2ab2f98edc0c08, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,696 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3eb86a4406fc57484a9d5a7ea1f24c91 in 63ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:44,696 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3eb86a4406fc57484a9d5a7ea1f24c91: 2023-02-17 18:01:44,696 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,696 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,696 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/53a6adef23a9493bb6de7ac504649193] hfiles 2023-02-17 18:01:44,696 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/53a6adef23a9493bb6de7ac504649193 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,696 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/1dbee9dae9764128ac2ab2f98edc0c08] hfiles 2023-02-17 18:01:44,696 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/1dbee9dae9764128ac2ab2f98edc0c08 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,701 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. completed. 2023-02-17 18:01:44,701 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:44,701 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-17 18:01:44,710 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:44,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 18:01:44,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:44,711 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-17 18:01:44,951 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/.tmp/f2/6be1e4cd210c4164ae276b81b8742320 2023-02-17 18:01:44,952 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/.tmp/f1/34a24a35ab9a4d4dbc16fb6635dfc3ea 2023-02-17 18:01:44,956 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/.tmp/f1/c1f9727f871b4573888f4ec7092ef51a as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/c1f9727f871b4573888f4ec7092ef51a 2023-02-17 18:01:44,963 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/c1f9727f871b4573888f4ec7092ef51a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,964 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/.tmp/f2/6be1e4cd210c4164ae276b81b8742320 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/6be1e4cd210c4164ae276b81b8742320 2023-02-17 18:01:44,970 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/6be1e4cd210c4164ae276b81b8742320, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-17 18:01:44,971 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 952edab40cfee0885d2a7504c18c0baa in 519ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:44,971 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 952edab40cfee0885d2a7504c18c0baa: 2023-02-17 18:01:44,971 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/.tmp/f2/60569763900641b0a389db6a4b2c7488 2023-02-17 18:01:44,971 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,971 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,971 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/c1f9727f871b4573888f4ec7092ef51a] hfiles 2023-02-17 18:01:44,971 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/c1f9727f871b4573888f4ec7092ef51a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,971 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/6be1e4cd210c4164ae276b81b8742320] hfiles 2023-02-17 18:01:44,971 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/6be1e4cd210c4164ae276b81b8742320 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,976 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/.tmp/f1/34a24a35ab9a4d4dbc16fb6635dfc3ea as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/34a24a35ab9a4d4dbc16fb6635dfc3ea 2023-02-17 18:01:44,978 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. completed. 2023-02-17 18:01:44,978 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:44,978 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 18:01:44,978 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 18:01:44,978 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,978 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 18:01:44,978 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43317,1676656902495' in zk 2023-02-17 18:01:44,980 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/34a24a35ab9a4d4dbc16fb6635dfc3ea, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:44,981 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/.tmp/f2/60569763900641b0a389db6a4b2c7488 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/60569763900641b0a389db6a4b2c7488 2023-02-17 18:01:44,981 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,981 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 18:01:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:44,982 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:44,982 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 18:01:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:44,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:44,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:44,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43317,1676656902495': 2023-02-17 18:01:44,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43317,1676656902495' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 18:01:44,986 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/60569763900641b0a389db6a4b2c7488, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-17 18:01:44,986 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4fd0627db9cbe09e51eb5748fc382373 in 487ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:44,986 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4fd0627db9cbe09e51eb5748fc382373: 2023-02-17 18:01:44,987 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,987 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:44,987 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/34a24a35ab9a4d4dbc16fb6635dfc3ea] hfiles 2023-02-17 18:01:44,987 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/34a24a35ab9a4d4dbc16fb6635dfc3ea for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,987 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/60569763900641b0a389db6a4b2c7488] hfiles 2023-02-17 18:01:44,987 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/60569763900641b0a389db6a4b2c7488 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,994 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. completed. 2023-02-17 18:01:44,994 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:44,994 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-17 18:01:44,994 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-17 18:01:44,994 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,994 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 18:01:44,994 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40377,1676656902457' in zk 2023-02-17 18:01:44,995 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 18:01:44,995 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,995 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:44,996 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 18:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40377,1676656902457': 2023-02-17 18:01:44,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40377,1676656902457' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 18:01:44,999 INFO [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-17 18:01:44,999 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:44,999 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:44,999 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-17 18:01:44,999 INFO [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 18:01:45,000 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,000 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:45,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:45,000 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,000 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,001 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:45,001 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:45,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:45,001 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:45,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,003 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:45,003 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,009 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,009 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:45,009 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:45,009 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:45,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:45,009 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:45,009 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:45,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:45,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,009 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:45,009 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,010 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,010 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:45,010 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,010 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,010 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,010 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:45,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,011 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:45,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 18:01:45,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:45,013 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-17 18:01:45,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-17 18:01:45,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,069 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676656904406Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676656905010 (+604 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676656905010Writing data manifest for testWithMockedMapReduceMultiRegion at 1676656905017 (+7 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676656905031 (+14 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676656905069 (+38 ms) 2023-02-17 18:01:45,071 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-17 18:01:45,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 664 msec 2023-02-17 18:01:45,513 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:45,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-17 18:01:45,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 18:01:45,514 INFO [Listener at localhost/34907] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 18:01:45,519 INFO [Listener at localhost/34907] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 18:01:45,524 INFO [Listener at localhost/34907] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 18:01:45,553 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40377] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:45,554 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43317] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:45,615 INFO [Listener at localhost/34907] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 18:01:45,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 18:01:45,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,626 INFO [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-17 18:01:45,626 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:45,627 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-17 18:01:45,627 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-17 18:01:45,628 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,628 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,629 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,630 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,630 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,630 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,630 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:45,631 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:45,631 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:45,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:45,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:45,632 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,632 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,636 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-17 18:01:45,636 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:45,637 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 18:01:45,637 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-17 18:01:45,637 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:45,638 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-17 18:01:45,638 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:45,638 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. started... 2023-02-17 18:01:45,638 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:45,638 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. started... 2023-02-17 18:01:45,638 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a5821f8d4d4b563b416976e7cac4c5c1: 2023-02-17 18:01:45,638 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:45,638 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 288a300782b44ac82fa24ad0dbc7d7f8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:45,639 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:45,639 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 18:01:45,639 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:01:45,639 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:45,639 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:45,639 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. started... 2023-02-17 18:01:45,640 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. started... 2023-02-17 18:01:45,639 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:45,639 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. started... 2023-02-17 18:01:45,640 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4fd0627db9cbe09e51eb5748fc382373 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 18:01:45,639 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-17 18:01:45,641 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:01:45,639 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 18:01:45,639 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:45,641 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. started... 2023-02-17 18:01:45,640 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. started... 2023-02-17 18:01:45,641 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6ae3ca2c1acd14792eb5295cd5402e83 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:45,640 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1ecdb84e325d1a1f1bf4c4fde38c5ae6: 2023-02-17 18:01:45,640 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 952edab40cfee0885d2a7504c18c0baa 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:45,642 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:45,641 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 87ac265a19634ca6fe96a4aabe2d8607 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:45,643 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-17 18:01:45,643 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:45,644 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. started... 2023-02-17 18:01:45,644 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 97e3bb502cfdc46374faac1936b51422 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-17 18:01:45,677 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/.tmp/f1/aef2e21a175c49c682e46de5da5e5b9b 2023-02-17 18:01:45,683 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/.tmp/f1/5e76f7e2443448f5a04209675153420d 2023-02-17 18:01:45,684 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/.tmp/f1/dec57d23a880488aa4856c08d4e3dba8 2023-02-17 18:01:45,684 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/.tmp/f1/e7f7959f3980425d97e1a34b9bd487fb 2023-02-17 18:01:45,686 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/.tmp/f1/96542bb291324fdcb32596c282268118 2023-02-17 18:01:45,691 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/.tmp/f1/cc6f2c9adf684e3d9e6812339c874828 2023-02-17 18:01:45,732 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/.tmp/f2/2d67a3f94ae747e6abbeff02015fd8de 2023-02-17 18:01:45,736 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/.tmp/f2/542a0b300a564913985cfa4ea4dd0d33 2023-02-17 18:01:45,739 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/.tmp/f1/e7f7959f3980425d97e1a34b9bd487fb as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/e7f7959f3980425d97e1a34b9bd487fb 2023-02-17 18:01:45,741 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/.tmp/f2/0a1724ff6db64779926660cb84f2a9d0 2023-02-17 18:01:45,744 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/.tmp/f1/aef2e21a175c49c682e46de5da5e5b9b as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/aef2e21a175c49c682e46de5da5e5b9b 2023-02-17 18:01:45,748 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/e7f7959f3980425d97e1a34b9bd487fb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,749 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/.tmp/f1/96542bb291324fdcb32596c282268118 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/96542bb291324fdcb32596c282268118 2023-02-17 18:01:45,749 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/aef2e21a175c49c682e46de5da5e5b9b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,749 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/.tmp/f2/2d67a3f94ae747e6abbeff02015fd8de as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/2d67a3f94ae747e6abbeff02015fd8de 2023-02-17 18:01:45,750 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/.tmp/f2/542a0b300a564913985cfa4ea4dd0d33 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/542a0b300a564913985cfa4ea4dd0d33 2023-02-17 18:01:45,754 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/96542bb291324fdcb32596c282268118, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:45,755 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/.tmp/f2/0a1724ff6db64779926660cb84f2a9d0 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/0a1724ff6db64779926660cb84f2a9d0 2023-02-17 18:01:45,755 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/2d67a3f94ae747e6abbeff02015fd8de, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,756 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6ae3ca2c1acd14792eb5295cd5402e83 in 115ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:45,756 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6ae3ca2c1acd14792eb5295cd5402e83: 2023-02-17 18:01:45,756 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:45,758 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:45,758 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 18:01:45,758 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. started... 2023-02-17 18:01:45,759 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d7518835bdc62d8a5afef2b993a037dc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:45,759 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/0a1724ff6db64779926660cb84f2a9d0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:45,760 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/542a0b300a564913985cfa4ea4dd0d33, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,760 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4fd0627db9cbe09e51eb5748fc382373 in 120ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:45,760 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 87ac265a19634ca6fe96a4aabe2d8607 in 119ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:45,760 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4fd0627db9cbe09e51eb5748fc382373: 2023-02-17 18:01:45,760 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 87ac265a19634ca6fe96a4aabe2d8607: 2023-02-17 18:01:45,760 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:45,760 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 18:01:45,761 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-17 18:01:45,761 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:45,761 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. started... 2023-02-17 18:01:45,761 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3eb86a4406fc57484a9d5a7ea1f24c91 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-17 18:01:45,769 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/.tmp/f2/b699c81541ee43dcbc0d29ff353042f4 2023-02-17 18:01:45,772 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/.tmp/f2/54bc6d911f1f4e26918a7ba767c3b829 2023-02-17 18:01:45,772 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/.tmp/f2/b4e495dcf4584694ad3cd0c1ab21f241 2023-02-17 18:01:45,774 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/.tmp/f1/dec57d23a880488aa4856c08d4e3dba8 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/dec57d23a880488aa4856c08d4e3dba8 2023-02-17 18:01:45,779 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/.tmp/f1/cc6f2c9adf684e3d9e6812339c874828 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/cc6f2c9adf684e3d9e6812339c874828 2023-02-17 18:01:45,790 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/cc6f2c9adf684e3d9e6812339c874828, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:45,791 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/.tmp/f2/54bc6d911f1f4e26918a7ba767c3b829 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/54bc6d911f1f4e26918a7ba767c3b829 2023-02-17 18:01:45,792 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/.tmp/f1/5a01ca1cd2a843f5b9295c99882c5111 2023-02-17 18:01:45,792 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/.tmp/f1/5e76f7e2443448f5a04209675153420d as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/5e76f7e2443448f5a04209675153420d 2023-02-17 18:01:45,793 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/.tmp/f1/39856a28794e44c88832b931b16f14e9 2023-02-17 18:01:45,795 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/dec57d23a880488aa4856c08d4e3dba8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,797 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/.tmp/f2/b699c81541ee43dcbc0d29ff353042f4 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/b699c81541ee43dcbc0d29ff353042f4 2023-02-17 18:01:45,800 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/5e76f7e2443448f5a04209675153420d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,801 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/54bc6d911f1f4e26918a7ba767c3b829, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-17 18:01:45,802 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 97e3bb502cfdc46374faac1936b51422 in 158ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:45,802 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 97e3bb502cfdc46374faac1936b51422: 2023-02-17 18:01:45,802 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:45,802 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-17 18:01:45,804 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/.tmp/f2/b4e495dcf4584694ad3cd0c1ab21f241 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/b4e495dcf4584694ad3cd0c1ab21f241 2023-02-17 18:01:45,810 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/b699c81541ee43dcbc0d29ff353042f4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,811 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 952edab40cfee0885d2a7504c18c0baa in 171ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:45,811 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 952edab40cfee0885d2a7504c18c0baa: 2023-02-17 18:01:45,811 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:45,811 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 18:01:45,812 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/.tmp/f2/0f4349634bf845218d662777a085f271 2023-02-17 18:01:45,815 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/b4e495dcf4584694ad3cd0c1ab21f241, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,816 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 288a300782b44ac82fa24ad0dbc7d7f8 in 178ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:45,816 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 288a300782b44ac82fa24ad0dbc7d7f8: 2023-02-17 18:01:45,816 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:45,816 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-17 18:01:45,821 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/.tmp/f1/5a01ca1cd2a843f5b9295c99882c5111 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/5a01ca1cd2a843f5b9295c99882c5111 2023-02-17 18:01:45,825 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/5a01ca1cd2a843f5b9295c99882c5111, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,826 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/.tmp/f2/0f4349634bf845218d662777a085f271 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/0f4349634bf845218d662777a085f271 2023-02-17 18:01:45,831 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/.tmp/f2/a7dfd1553bf34d05a99bae8eb76ad121 2023-02-17 18:01:45,832 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/0f4349634bf845218d662777a085f271, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,833 INFO [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d7518835bdc62d8a5afef2b993a037dc in 74ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:45,833 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d7518835bdc62d8a5afef2b993a037dc: 2023-02-17 18:01:45,833 DEBUG [rs(jenkins-hbase4.apache.org,40377,1676656902457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 18:01:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 18:01:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 18:01:45,833 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40377,1676656902457' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 18:01:45,835 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,835 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:45,835 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,835 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:45,836 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/.tmp/f1/39856a28794e44c88832b931b16f14e9 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/39856a28794e44c88832b931b16f14e9 2023-02-17 18:01:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:45,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40377,1676656902457' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 18:01:45,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b661654[Count = 1] remaining members to acquire global barrier 2023-02-17 18:01:45,841 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/39856a28794e44c88832b931b16f14e9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,841 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/.tmp/f2/a7dfd1553bf34d05a99bae8eb76ad121 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/a7dfd1553bf34d05a99bae8eb76ad121 2023-02-17 18:01:45,848 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/a7dfd1553bf34d05a99bae8eb76ad121, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-17 18:01:45,849 INFO [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3eb86a4406fc57484a9d5a7ea1f24c91 in 88ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:45,849 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3eb86a4406fc57484a9d5a7ea1f24c91: 2023-02-17 18:01:45,849 DEBUG [rs(jenkins-hbase4.apache.org,43317,1676656902495)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:45,849 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-17 18:01:45,849 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-17 18:01:45,849 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,849 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-17 18:01:45,849 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43317,1676656902495' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-17 18:01:45,852 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,853 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,853 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,853 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:45,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:45,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:45,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:45,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43317,1676656902495' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-17 18:01:45,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b661654[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:45,856 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-17 18:01:45,856 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,857 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,857 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,857 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 18:01:45,857 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-17 18:01:45,857 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 18:01:45,857 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43317,1676656902495' in zk 2023-02-17 18:01:45,857 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-17 18:01:45,857 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40377,1676656902457' in zk 2023-02-17 18:01:45,857 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,858 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,858 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:45,859 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,859 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 18:01:45,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,859 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,859 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-17 18:01:45,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:45,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:45,859 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:45,859 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:45,859 DEBUG [member: 'jenkins-hbase4.apache.org,40377,1676656902457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 18:01:45,859 DEBUG [member: 'jenkins-hbase4.apache.org,43317,1676656902495' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-17 18:01:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:45,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43317,1676656902495': 2023-02-17 18:01:45,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43317,1676656902495' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-17 18:01:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:45,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:45,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:45,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40377,1676656902457': 2023-02-17 18:01:45,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40377,1676656902457' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-17 18:01:45,867 INFO [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-17 18:01:45,867 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:45,867 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:45,867 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,867 INFO [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 18:01:45,869 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,869 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,869 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:45,869 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:45,869 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:45,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:45,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:45,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:45,870 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:45,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:45,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,870 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:45,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:45,872 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,872 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,875 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,875 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:45,875 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:45,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:45,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:45,876 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-17 18:01:45,876 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 18:01:45,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:45,875 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:45,875 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:45,875 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:45,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:45,876 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:45,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:45,876 DEBUG [(jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:45,876 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 18:01:45,876 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,877 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,877 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:45,877 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,877 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:45,877 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:45,877 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,977 DEBUG [Listener at localhost/34907] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 18:01:45,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 18:01:45,983 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676656904382 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:45,983 DEBUG [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,983 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:45,983 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:45,983 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:45,983 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(239): region to add: d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=1ecdb84e325d1a1f1bf4c4fde38c5ae6 as 1ecdb84e325d1a1f1bf4c4fde38c5ae6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=87ac265a19634ca6fe96a4aabe2d8607 as 87ac265a19634ca6fe96a4aabe2d8607 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=952edab40cfee0885d2a7504c18c0baa as 952edab40cfee0885d2a7504c18c0baa in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=a5821f8d4d4b563b416976e7cac4c5c1 as a5821f8d4d4b563b416976e7cac4c5c1 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=97e3bb502cfdc46374faac1936b51422 as 97e3bb502cfdc46374faac1936b51422 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=288a300782b44ac82fa24ad0dbc7d7f8 as 288a300782b44ac82fa24ad0dbc7d7f8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=3eb86a4406fc57484a9d5a7ea1f24c91 as 3eb86a4406fc57484a9d5a7ea1f24c91 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=4fd0627db9cbe09e51eb5748fc382373 as 4fd0627db9cbe09e51eb5748fc382373 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=6ae3ca2c1acd14792eb5295cd5402e83 as 6ae3ca2c1acd14792eb5295cd5402e83 in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,984 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(585): clone region=d7518835bdc62d8a5afef2b993a037dc as d7518835bdc62d8a5afef2b993a037dc in snapshot testWithMockedMapReduceMultiRegion 2023-02-17 18:01:45,985 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 4fd0627db9cbe09e51eb5748fc382373, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:45,986 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 3eb86a4406fc57484a9d5a7ea1f24c91, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:45,986 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1ecdb84e325d1a1f1bf4c4fde38c5ae6, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:45,986 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 288a300782b44ac82fa24ad0dbc7d7f8, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:45,986 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => a5821f8d4d4b563b416976e7cac4c5c1, NAME => 'testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:45,986 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 952edab40cfee0885d2a7504c18c0baa, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:45,987 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 87ac265a19634ca6fe96a4aabe2d8607, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:45,987 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 97e3bb502cfdc46374faac1936b51422, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:46,008 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,008 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 53a6adef23a9493bb6de7ac504649193 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,013 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,013 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing a5821f8d4d4b563b416976e7cac4c5c1, disabling compactions & flushes 2023-02-17 18:01:46,013 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:46,013 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:46,013 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. after waiting 0 ms 2023-02-17 18:01:46,013 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:46,013 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:46,013 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,013 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for a5821f8d4d4b563b416976e7cac4c5c1: 2023-02-17 18:01:46,013 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 68f9d9d397d94a8da1de7fed44539402 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,014 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 6ae3ca2c1acd14792eb5295cd5402e83, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:46,014 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1dbee9dae9764128ac2ab2f98edc0c08 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,021 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3b31ab632b2d4758b15624fdaa92140b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 3eb86a4406fc57484a9d5a7ea1f24c91, disabling compactions & flushes 2023-02-17 18:01:46,022 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:46,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:46,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. after waiting 0 ms 2023-02-17 18:01:46,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:46,022 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:46,022 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 3eb86a4406fc57484a9d5a7ea1f24c91: 2023-02-17 18:01:46,023 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => d7518835bdc62d8a5afef2b993a037dc, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:46,025 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,025 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,025 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 34a24a35ab9a4d4dbc16fb6635dfc3ea from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,025 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 332f4f44c7ff4f33aa29c82bbd42bb11 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,025 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,025 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c1f9727f871b4573888f4ec7092ef51a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,028 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,028 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1ecdb84e325d1a1f1bf4c4fde38c5ae6, disabling compactions & flushes 2023-02-17 18:01:46,028 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:46,028 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:46,028 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. after waiting 0 ms 2023-02-17 18:01:46,028 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:46,028 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:46,028 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1ecdb84e325d1a1f1bf4c4fde38c5ae6: 2023-02-17 18:01:46,031 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,031 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5d91c349fc524669a80fb50ecff26ff5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,038 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 60569763900641b0a389db6a4b2c7488 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,038 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 17194578853e49e18e08875cb34aaedc from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,039 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6be1e4cd210c4164ae276b81b8742320 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,039 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 87ac265a19634ca6fe96a4aabe2d8607, disabling compactions & flushes 2023-02-17 18:01:46,039 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:46,039 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,039 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:46,039 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. after waiting 0 ms 2023-02-17 18:01:46,039 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:46,039 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:46,039 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 87ac265a19634ca6fe96a4aabe2d8607: 2023-02-17 18:01:46,039 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 45d0e1f7a71746e68417205dd2635d76 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,041 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd5fd05f760343c482c9318351fa5c44 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,044 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,044 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c873bd1a80184f65a0f1c536e5105a16 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,044 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 952edab40cfee0885d2a7504c18c0baa, disabling compactions & flushes 2023-02-17 18:01:46,044 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 288a300782b44ac82fa24ad0dbc7d7f8, disabling compactions & flushes 2023-02-17 18:01:46,045 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:46,045 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0664d4ba5bed4f439724cef0f02d880d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,044 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 4fd0627db9cbe09e51eb5748fc382373, disabling compactions & flushes 2023-02-17 18:01:46,044 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:46,045 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 97e3bb502cfdc46374faac1936b51422, disabling compactions & flushes 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:46,045 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. after waiting 0 ms 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. after waiting 0 ms 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. after waiting 0 ms 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. after waiting 0 ms 2023-02-17 18:01:46,045 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:46,046 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:46,046 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 4fd0627db9cbe09e51eb5748fc382373: 2023-02-17 18:01:46,045 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:46,046 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 97e3bb502cfdc46374faac1936b51422: 2023-02-17 18:01:46,046 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:46,046 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:46,046 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 952edab40cfee0885d2a7504c18c0baa: 2023-02-17 18:01:46,046 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 288a300782b44ac82fa24ad0dbc7d7f8: 2023-02-17 18:01:46,046 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 953c76ab50784139a131e0c2ba4a965b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,047 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 6ae3ca2c1acd14792eb5295cd5402e83, disabling compactions & flushes 2023-02-17 18:01:46,047 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:46,047 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:46,047 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. after waiting 0 ms 2023-02-17 18:01:46,047 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:46,047 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:46,047 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 6ae3ca2c1acd14792eb5295cd5402e83: 2023-02-17 18:01:46,048 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing d7518835bdc62d8a5afef2b993a037dc, disabling compactions & flushes 2023-02-17 18:01:46,048 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:46,048 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:46,048 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. after waiting 0 ms 2023-02-17 18:01:46,048 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:46,048 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:46,048 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for d7518835bdc62d8a5afef2b993a037dc: 2023-02-17 18:01:46,049 INFO [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676656904382 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:46,049 DEBUG [Listener at localhost/34907] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:46,049 DEBUG [Listener at localhost/34907] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4 2023-02-17 18:01:46,049 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-data/ 2023-02-17 18:01:46,050 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----default/ 2023-02-17 18:01:46,050 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-17 18:01:46,050 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------1ecdb84e325d1a1f1bf4c4fde38c5ae6/ 2023-02-17 18:01:46,050 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,050 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------288a300782b44ac82fa24ad0dbc7d7f8/ 2023-02-17 18:01:46,051 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,051 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:46,051 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=288a300782b44ac82fa24ad0dbc7d7f8-332f4f44c7ff4f33aa29c82bbd42bb11 2023-02-17 18:01:46,051 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:46,051 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=288a300782b44ac82fa24ad0dbc7d7f8-17194578853e49e18e08875cb34aaedc 2023-02-17 18:01:46,051 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------3eb86a4406fc57484a9d5a7ea1f24c91/ 2023-02-17 18:01:46,051 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,052 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:46,052 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3eb86a4406fc57484a9d5a7ea1f24c91-53a6adef23a9493bb6de7ac504649193 2023-02-17 18:01:46,052 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:46,052 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3eb86a4406fc57484a9d5a7ea1f24c91-1dbee9dae9764128ac2ab2f98edc0c08 2023-02-17 18:01:46,052 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------4fd0627db9cbe09e51eb5748fc382373/ 2023-02-17 18:01:46,052 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,052 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:46,053 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4fd0627db9cbe09e51eb5748fc382373-34a24a35ab9a4d4dbc16fb6635dfc3ea 2023-02-17 18:01:46,053 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:46,053 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4fd0627db9cbe09e51eb5748fc382373-60569763900641b0a389db6a4b2c7488 2023-02-17 18:01:46,053 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------6ae3ca2c1acd14792eb5295cd5402e83/ 2023-02-17 18:01:46,053 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,053 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:46,053 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6ae3ca2c1acd14792eb5295cd5402e83-45d0e1f7a71746e68417205dd2635d76 2023-02-17 18:01:46,053 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:46,054 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6ae3ca2c1acd14792eb5295cd5402e83-0664d4ba5bed4f439724cef0f02d880d 2023-02-17 18:01:46,054 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------87ac265a19634ca6fe96a4aabe2d8607/ 2023-02-17 18:01:46,054 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,054 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:46,054 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=87ac265a19634ca6fe96a4aabe2d8607-68f9d9d397d94a8da1de7fed44539402 2023-02-17 18:01:46,054 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:46,054 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=87ac265a19634ca6fe96a4aabe2d8607-3b31ab632b2d4758b15624fdaa92140b 2023-02-17 18:01:46,054 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------952edab40cfee0885d2a7504c18c0baa/ 2023-02-17 18:01:46,055 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,055 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:46,055 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=952edab40cfee0885d2a7504c18c0baa-c1f9727f871b4573888f4ec7092ef51a 2023-02-17 18:01:46,055 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:46,055 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=952edab40cfee0885d2a7504c18c0baa-6be1e4cd210c4164ae276b81b8742320 2023-02-17 18:01:46,055 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------97e3bb502cfdc46374faac1936b51422/ 2023-02-17 18:01:46,055 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,055 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:46,056 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=97e3bb502cfdc46374faac1936b51422-5d91c349fc524669a80fb50ecff26ff5 2023-02-17 18:01:46,056 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:46,056 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=97e3bb502cfdc46374faac1936b51422-dd5fd05f760343c482c9318351fa5c44 2023-02-17 18:01:46,056 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------a5821f8d4d4b563b416976e7cac4c5c1/ 2023-02-17 18:01:46,056 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,056 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |----------d7518835bdc62d8a5afef2b993a037dc/ 2023-02-17 18:01:46,057 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:46,057 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:46,057 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d7518835bdc62d8a5afef2b993a037dc-c873bd1a80184f65a0f1c536e5105a16 2023-02-17 18:01:46,057 DEBUG [Listener at localhost/34907] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:46,057 DEBUG [Listener at localhost/34907] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d7518835bdc62d8a5afef2b993a037dc-953c76ab50784139a131e0c2ba4a965b 2023-02-17 18:01:46,060 INFO [Listener at localhost/34907] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 18:01:46,590 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,590 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,592 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,594 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:46,594 DEBUG [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1 2023-02-17 18:01:46,595 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eb86a4406fc57484a9d5a7ea1f24c91 columnFamilyName f1 2023-02-17 18:01:46,599 DEBUG [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/testWithMockedMapReduceMultiRegion=3eb86a4406fc57484a9d5a7ea1f24c91-53a6adef23a9493bb6de7ac504649193 2023-02-17 18:01:46,599 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(310): Store=3eb86a4406fc57484a9d5a7ea1f24c91/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,599 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:46,600 DEBUG [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2 2023-02-17 18:01:46,600 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3eb86a4406fc57484a9d5a7ea1f24c91 columnFamilyName f2 2023-02-17 18:01:46,604 DEBUG [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/testWithMockedMapReduceMultiRegion=3eb86a4406fc57484a9d5a7ea1f24c91-1dbee9dae9764128ac2ab2f98edc0c08 2023-02-17 18:01:46,604 INFO [StoreOpener-3eb86a4406fc57484a9d5a7ea1f24c91-1] regionserver.HStore(310): Store=3eb86a4406fc57484a9d5a7ea1f24c91/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,604 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,604 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened 3eb86a4406fc57484a9d5a7ea1f24c91; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69820240, jitterRate=0.04040265083312988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,604 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for 3eb86a4406fc57484a9d5a7ea1f24c91: 2023-02-17 18:01:46,613 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing 3eb86a4406fc57484a9d5a7ea1f24c91, disabling compactions & flushes 2023-02-17 18:01:46,613 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:46,613 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:46,613 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. after waiting 0 ms 2023-02-17 18:01:46,613 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:46,616 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:46,616 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for 3eb86a4406fc57484a9d5a7ea1f24c91: 2023-02-17 18:01:46,617 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,617 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,618 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,622 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:46,623 DEBUG [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/f1 2023-02-17 18:01:46,623 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ecdb84e325d1a1f1bf4c4fde38c5ae6 columnFamilyName f1 2023-02-17 18:01:46,624 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] regionserver.HStore(310): Store=1ecdb84e325d1a1f1bf4c4fde38c5ae6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,624 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:46,625 DEBUG [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/f2 2023-02-17 18:01:46,626 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ecdb84e325d1a1f1bf4c4fde38c5ae6 columnFamilyName f2 2023-02-17 18:01:46,626 INFO [StoreOpener-1ecdb84e325d1a1f1bf4c4fde38c5ae6-1] regionserver.HStore(310): Store=1ecdb84e325d1a1f1bf4c4fde38c5ae6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,626 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,626 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened 1ecdb84e325d1a1f1bf4c4fde38c5ae6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67710704, jitterRate=0.008968114852905273}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,626 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for 1ecdb84e325d1a1f1bf4c4fde38c5ae6: 2023-02-17 18:01:46,627 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing 1ecdb84e325d1a1f1bf4c4fde38c5ae6, disabling compactions & flushes 2023-02-17 18:01:46,627 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:46,627 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:46,627 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. after waiting 0 ms 2023-02-17 18:01:46,627 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:46,627 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:46,627 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for 1ecdb84e325d1a1f1bf4c4fde38c5ae6: 2023-02-17 18:01:46,628 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,628 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,631 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,636 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:46,637 DEBUG [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1 2023-02-17 18:01:46,637 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 288a300782b44ac82fa24ad0dbc7d7f8 columnFamilyName f1 2023-02-17 18:01:46,642 DEBUG [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/testWithMockedMapReduceMultiRegion=288a300782b44ac82fa24ad0dbc7d7f8-332f4f44c7ff4f33aa29c82bbd42bb11 2023-02-17 18:01:46,642 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(310): Store=288a300782b44ac82fa24ad0dbc7d7f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,642 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:46,643 DEBUG [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2 2023-02-17 18:01:46,643 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 288a300782b44ac82fa24ad0dbc7d7f8 columnFamilyName f2 2023-02-17 18:01:46,647 DEBUG [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/testWithMockedMapReduceMultiRegion=288a300782b44ac82fa24ad0dbc7d7f8-17194578853e49e18e08875cb34aaedc 2023-02-17 18:01:46,647 INFO [StoreOpener-288a300782b44ac82fa24ad0dbc7d7f8-1] regionserver.HStore(310): Store=288a300782b44ac82fa24ad0dbc7d7f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,648 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,648 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened 288a300782b44ac82fa24ad0dbc7d7f8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65180781, jitterRate=-0.02873067557811737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,648 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for 288a300782b44ac82fa24ad0dbc7d7f8: 2023-02-17 18:01:46,659 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing 288a300782b44ac82fa24ad0dbc7d7f8, disabling compactions & flushes 2023-02-17 18:01:46,661 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:46,661 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:46,661 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. after waiting 0 ms 2023-02-17 18:01:46,661 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:46,661 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:46,662 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for 288a300782b44ac82fa24ad0dbc7d7f8: 2023-02-17 18:01:46,662 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,662 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,664 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,666 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:46,666 DEBUG [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1 2023-02-17 18:01:46,667 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fd0627db9cbe09e51eb5748fc382373 columnFamilyName f1 2023-02-17 18:01:46,671 DEBUG [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/testWithMockedMapReduceMultiRegion=4fd0627db9cbe09e51eb5748fc382373-34a24a35ab9a4d4dbc16fb6635dfc3ea 2023-02-17 18:01:46,671 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(310): Store=4fd0627db9cbe09e51eb5748fc382373/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,671 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:46,672 DEBUG [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2 2023-02-17 18:01:46,672 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fd0627db9cbe09e51eb5748fc382373 columnFamilyName f2 2023-02-17 18:01:46,677 DEBUG [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/testWithMockedMapReduceMultiRegion=4fd0627db9cbe09e51eb5748fc382373-60569763900641b0a389db6a4b2c7488 2023-02-17 18:01:46,677 INFO [StoreOpener-4fd0627db9cbe09e51eb5748fc382373-1] regionserver.HStore(310): Store=4fd0627db9cbe09e51eb5748fc382373/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,678 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,678 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened 4fd0627db9cbe09e51eb5748fc382373; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64283345, jitterRate=-0.042103514075279236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,678 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for 4fd0627db9cbe09e51eb5748fc382373: 2023-02-17 18:01:46,694 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing 4fd0627db9cbe09e51eb5748fc382373, disabling compactions & flushes 2023-02-17 18:01:46,694 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:46,694 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:46,694 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. after waiting 0 ms 2023-02-17 18:01:46,694 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:46,696 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:46,697 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for 4fd0627db9cbe09e51eb5748fc382373: 2023-02-17 18:01:46,697 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,697 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,700 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,705 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:46,707 DEBUG [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1 2023-02-17 18:01:46,707 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97e3bb502cfdc46374faac1936b51422 columnFamilyName f1 2023-02-17 18:01:46,720 DEBUG [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/testWithMockedMapReduceMultiRegion=97e3bb502cfdc46374faac1936b51422-5d91c349fc524669a80fb50ecff26ff5 2023-02-17 18:01:46,720 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(310): Store=97e3bb502cfdc46374faac1936b51422/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,720 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:46,722 DEBUG [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2 2023-02-17 18:01:46,722 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97e3bb502cfdc46374faac1936b51422 columnFamilyName f2 2023-02-17 18:01:46,734 DEBUG [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/testWithMockedMapReduceMultiRegion=97e3bb502cfdc46374faac1936b51422-dd5fd05f760343c482c9318351fa5c44 2023-02-17 18:01:46,734 INFO [StoreOpener-97e3bb502cfdc46374faac1936b51422-1] regionserver.HStore(310): Store=97e3bb502cfdc46374faac1936b51422/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,734 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,734 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened 97e3bb502cfdc46374faac1936b51422; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72903318, jitterRate=0.08634409308433533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,734 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for 97e3bb502cfdc46374faac1936b51422: 2023-02-17 18:01:46,750 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing 97e3bb502cfdc46374faac1936b51422, disabling compactions & flushes 2023-02-17 18:01:46,751 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:46,751 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:46,751 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. after waiting 0 ms 2023-02-17 18:01:46,751 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:46,756 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:46,757 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for 97e3bb502cfdc46374faac1936b51422: 2023-02-17 18:01:46,757 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,758 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,762 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,765 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:46,767 DEBUG [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1 2023-02-17 18:01:46,767 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ac265a19634ca6fe96a4aabe2d8607 columnFamilyName f1 2023-02-17 18:01:46,774 DEBUG [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/testWithMockedMapReduceMultiRegion=87ac265a19634ca6fe96a4aabe2d8607-68f9d9d397d94a8da1de7fed44539402 2023-02-17 18:01:46,775 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(310): Store=87ac265a19634ca6fe96a4aabe2d8607/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,775 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:46,775 DEBUG [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2 2023-02-17 18:01:46,776 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87ac265a19634ca6fe96a4aabe2d8607 columnFamilyName f2 2023-02-17 18:01:46,783 DEBUG [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/testWithMockedMapReduceMultiRegion=87ac265a19634ca6fe96a4aabe2d8607-3b31ab632b2d4758b15624fdaa92140b 2023-02-17 18:01:46,784 INFO [StoreOpener-87ac265a19634ca6fe96a4aabe2d8607-1] regionserver.HStore(310): Store=87ac265a19634ca6fe96a4aabe2d8607/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,784 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,784 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened 87ac265a19634ca6fe96a4aabe2d8607; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61911567, jitterRate=-0.07744576036930084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,784 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for 87ac265a19634ca6fe96a4aabe2d8607: 2023-02-17 18:01:46,795 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing 87ac265a19634ca6fe96a4aabe2d8607, disabling compactions & flushes 2023-02-17 18:01:46,795 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:46,795 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:46,795 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. after waiting 0 ms 2023-02-17 18:01:46,834 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:46,836 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:46,836 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for 87ac265a19634ca6fe96a4aabe2d8607: 2023-02-17 18:01:46,837 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,837 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,852 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,858 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:46,860 DEBUG [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1 2023-02-17 18:01:46,860 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ae3ca2c1acd14792eb5295cd5402e83 columnFamilyName f1 2023-02-17 18:01:46,868 DEBUG [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/testWithMockedMapReduceMultiRegion=6ae3ca2c1acd14792eb5295cd5402e83-45d0e1f7a71746e68417205dd2635d76 2023-02-17 18:01:46,868 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(310): Store=6ae3ca2c1acd14792eb5295cd5402e83/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,869 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:46,870 DEBUG [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2 2023-02-17 18:01:46,870 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ae3ca2c1acd14792eb5295cd5402e83 columnFamilyName f2 2023-02-17 18:01:46,876 DEBUG [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/testWithMockedMapReduceMultiRegion=6ae3ca2c1acd14792eb5295cd5402e83-0664d4ba5bed4f439724cef0f02d880d 2023-02-17 18:01:46,876 INFO [StoreOpener-6ae3ca2c1acd14792eb5295cd5402e83-1] regionserver.HStore(310): Store=6ae3ca2c1acd14792eb5295cd5402e83/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,876 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,876 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened 6ae3ca2c1acd14792eb5295cd5402e83; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61715073, jitterRate=-0.08037374913692474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,876 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for 6ae3ca2c1acd14792eb5295cd5402e83: 2023-02-17 18:01:46,888 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing 6ae3ca2c1acd14792eb5295cd5402e83, disabling compactions & flushes 2023-02-17 18:01:46,888 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:46,888 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:46,888 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. after waiting 0 ms 2023-02-17 18:01:46,888 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:46,904 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:46,905 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for 6ae3ca2c1acd14792eb5295cd5402e83: 2023-02-17 18:01:46,905 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,906 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,908 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,910 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:46,912 DEBUG [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/f1 2023-02-17 18:01:46,912 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5821f8d4d4b563b416976e7cac4c5c1 columnFamilyName f1 2023-02-17 18:01:46,913 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] regionserver.HStore(310): Store=a5821f8d4d4b563b416976e7cac4c5c1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,913 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:46,915 DEBUG [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/f2 2023-02-17 18:01:46,915 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a5821f8d4d4b563b416976e7cac4c5c1 columnFamilyName f2 2023-02-17 18:01:46,916 INFO [StoreOpener-a5821f8d4d4b563b416976e7cac4c5c1-1] regionserver.HStore(310): Store=a5821f8d4d4b563b416976e7cac4c5c1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,916 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,916 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened a5821f8d4d4b563b416976e7cac4c5c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63208981, jitterRate=-0.05811278522014618}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,916 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for a5821f8d4d4b563b416976e7cac4c5c1: 2023-02-17 18:01:46,917 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing a5821f8d4d4b563b416976e7cac4c5c1, disabling compactions & flushes 2023-02-17 18:01:46,917 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:46,917 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:46,917 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. after waiting 0 ms 2023-02-17 18:01:46,917 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:46,920 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:46,920 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for a5821f8d4d4b563b416976e7cac4c5c1: 2023-02-17 18:01:46,920 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,921 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,922 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,924 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:46,925 DEBUG [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1 2023-02-17 18:01:46,925 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7518835bdc62d8a5afef2b993a037dc columnFamilyName f1 2023-02-17 18:01:46,931 DEBUG [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/testWithMockedMapReduceMultiRegion=d7518835bdc62d8a5afef2b993a037dc-c873bd1a80184f65a0f1c536e5105a16 2023-02-17 18:01:46,931 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(310): Store=d7518835bdc62d8a5afef2b993a037dc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,931 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:46,933 DEBUG [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2 2023-02-17 18:01:46,933 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7518835bdc62d8a5afef2b993a037dc columnFamilyName f2 2023-02-17 18:01:46,938 DEBUG [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/testWithMockedMapReduceMultiRegion=d7518835bdc62d8a5afef2b993a037dc-953c76ab50784139a131e0c2ba4a965b 2023-02-17 18:01:46,938 INFO [StoreOpener-d7518835bdc62d8a5afef2b993a037dc-1] regionserver.HStore(310): Store=d7518835bdc62d8a5afef2b993a037dc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,938 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,938 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened d7518835bdc62d8a5afef2b993a037dc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60840364, jitterRate=-0.09340792894363403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,938 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for d7518835bdc62d8a5afef2b993a037dc: 2023-02-17 18:01:46,950 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing d7518835bdc62d8a5afef2b993a037dc, disabling compactions & flushes 2023-02-17 18:01:46,950 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:46,951 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:46,951 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. after waiting 0 ms 2023-02-17 18:01:46,951 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:46,952 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:46,952 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for d7518835bdc62d8a5afef2b993a037dc: 2023-02-17 18:01:46,952 DEBUG [Listener at localhost/34907] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:46,953 INFO [Listener at localhost/34907] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:46,954 DEBUG [Listener at localhost/34907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:46,956 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:46,957 DEBUG [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1 2023-02-17 18:01:46,958 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 952edab40cfee0885d2a7504c18c0baa columnFamilyName f1 2023-02-17 18:01:46,963 DEBUG [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/testWithMockedMapReduceMultiRegion=952edab40cfee0885d2a7504c18c0baa-c1f9727f871b4573888f4ec7092ef51a 2023-02-17 18:01:46,963 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(310): Store=952edab40cfee0885d2a7504c18c0baa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,963 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:46,964 DEBUG [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2 2023-02-17 18:01:46,964 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 952edab40cfee0885d2a7504c18c0baa columnFamilyName f2 2023-02-17 18:01:46,968 DEBUG [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(539): loaded hdfs://localhost:43825/user/jenkins/test-data/e6fe4010-a5a2-cf36-77d9-27ddd666e0a0/testWithMockedMapReduceMultiRegion/d3412761-4f1b-4f04-952e-a4bb0e514fb4/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/testWithMockedMapReduceMultiRegion=952edab40cfee0885d2a7504c18c0baa-6be1e4cd210c4164ae276b81b8742320 2023-02-17 18:01:46,968 INFO [StoreOpener-952edab40cfee0885d2a7504c18c0baa-1] regionserver.HStore(310): Store=952edab40cfee0885d2a7504c18c0baa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:46,968 DEBUG [Listener at localhost/34907] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:46,968 INFO [Listener at localhost/34907] regionserver.HRegion(1071): Opened 952edab40cfee0885d2a7504c18c0baa; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63103396, jitterRate=-0.059686124324798584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:46,968 DEBUG [Listener at localhost/34907] regionserver.HRegion(964): Region open journal for 952edab40cfee0885d2a7504c18c0baa: 2023-02-17 18:01:46,978 DEBUG [Listener at localhost/34907] regionserver.HRegion(1603): Closing 952edab40cfee0885d2a7504c18c0baa, disabling compactions & flushes 2023-02-17 18:01:46,980 INFO [Listener at localhost/34907] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:46,980 DEBUG [Listener at localhost/34907] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:46,980 DEBUG [Listener at localhost/34907] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. after waiting 0 ms 2023-02-17 18:01:46,980 DEBUG [Listener at localhost/34907] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:46,980 INFO [Listener at localhost/34907] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:46,981 DEBUG [Listener at localhost/34907] regionserver.HRegion(1557): Region close journal for 952edab40cfee0885d2a7504c18c0baa: 2023-02-17 18:01:46,985 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-17 18:01:46,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,989 INFO [Listener at localhost/34907] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:46,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 18:01:46,996 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656906995"}]},"ts":"1676656906995"} 2023-02-17 18:01:46,997 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-17 18:01:46,998 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-17 18:01:46,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5821f8d4d4b563b416976e7cac4c5c1, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=97e3bb502cfdc46374faac1936b51422, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=288a300782b44ac82fa24ad0dbc7d7f8, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=952edab40cfee0885d2a7504c18c0baa, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6ae3ca2c1acd14792eb5295cd5402e83, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac265a19634ca6fe96a4aabe2d8607, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7518835bdc62d8a5afef2b993a037dc, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3eb86a4406fc57484a9d5a7ea1f24c91, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4fd0627db9cbe09e51eb5748fc382373, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ecdb84e325d1a1f1bf4c4fde38c5ae6, UNASSIGN}] 2023-02-17 18:01:47,001 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=952edab40cfee0885d2a7504c18c0baa, UNASSIGN 2023-02-17 18:01:47,001 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5821f8d4d4b563b416976e7cac4c5c1, UNASSIGN 2023-02-17 18:01:47,001 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=288a300782b44ac82fa24ad0dbc7d7f8, UNASSIGN 2023-02-17 18:01:47,001 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=97e3bb502cfdc46374faac1936b51422, UNASSIGN 2023-02-17 18:01:47,002 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ecdb84e325d1a1f1bf4c4fde38c5ae6, UNASSIGN 2023-02-17 18:01:47,002 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=a5821f8d4d4b563b416976e7cac4c5c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:47,002 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=952edab40cfee0885d2a7504c18c0baa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:47,002 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=288a300782b44ac82fa24ad0dbc7d7f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:47,002 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907002"}]},"ts":"1676656907002"} 2023-02-17 18:01:47,002 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907002"}]},"ts":"1676656907002"} 2023-02-17 18:01:47,002 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656907002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907002"}]},"ts":"1676656907002"} 2023-02-17 18:01:47,003 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=97e3bb502cfdc46374faac1936b51422, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:47,003 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907003"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907003"}]},"ts":"1676656907003"} 2023-02-17 18:01:47,003 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=1ecdb84e325d1a1f1bf4c4fde38c5ae6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:47,003 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656907003"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907003"}]},"ts":"1676656907003"} 2023-02-17 18:01:47,004 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=37, state=RUNNABLE; CloseRegionProcedure 952edab40cfee0885d2a7504c18c0baa, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:47,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=36, state=RUNNABLE; CloseRegionProcedure 288a300782b44ac82fa24ad0dbc7d7f8, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:47,005 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=34, state=RUNNABLE; CloseRegionProcedure a5821f8d4d4b563b416976e7cac4c5c1, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:47,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=35, state=RUNNABLE; CloseRegionProcedure 97e3bb502cfdc46374faac1936b51422, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:47,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 1ecdb84e325d1a1f1bf4c4fde38c5ae6, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:47,007 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4fd0627db9cbe09e51eb5748fc382373, UNASSIGN 2023-02-17 18:01:47,008 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3eb86a4406fc57484a9d5a7ea1f24c91, UNASSIGN 2023-02-17 18:01:47,008 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4fd0627db9cbe09e51eb5748fc382373, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:47,008 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907008"}]},"ts":"1676656907008"} 2023-02-17 18:01:47,008 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7518835bdc62d8a5afef2b993a037dc, UNASSIGN 2023-02-17 18:01:47,008 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac265a19634ca6fe96a4aabe2d8607, UNASSIGN 2023-02-17 18:01:47,008 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3eb86a4406fc57484a9d5a7ea1f24c91, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:47,009 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907008"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907008"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907008"}]},"ts":"1676656907008"} 2023-02-17 18:01:47,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 4fd0627db9cbe09e51eb5748fc382373, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:47,009 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d7518835bdc62d8a5afef2b993a037dc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:47,009 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907009"}]},"ts":"1676656907009"} 2023-02-17 18:01:47,009 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6ae3ca2c1acd14792eb5295cd5402e83, UNASSIGN 2023-02-17 18:01:47,009 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=87ac265a19634ca6fe96a4aabe2d8607, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:47,010 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907009"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907009"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907009"}]},"ts":"1676656907009"} 2023-02-17 18:01:47,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 3eb86a4406fc57484a9d5a7ea1f24c91, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:47,011 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6ae3ca2c1acd14792eb5295cd5402e83, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:47,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure d7518835bdc62d8a5afef2b993a037dc, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:47,011 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656907011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656907011"}]},"ts":"1676656907011"} 2023-02-17 18:01:47,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 87ac265a19634ca6fe96a4aabe2d8607, server=jenkins-hbase4.apache.org,43317,1676656902495}] 2023-02-17 18:01:47,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 6ae3ca2c1acd14792eb5295cd5402e83, server=jenkins-hbase4.apache.org,40377,1676656902457}] 2023-02-17 18:01:47,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 18:01:47,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:47,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:47,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3eb86a4406fc57484a9d5a7ea1f24c91, disabling compactions & flushes 2023-02-17 18:01:47,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 288a300782b44ac82fa24ad0dbc7d7f8, disabling compactions & flushes 2023-02-17 18:01:47,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:47,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:47,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:47,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:47,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. after waiting 0 ms 2023-02-17 18:01:47,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:47,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. after waiting 0 ms 2023-02-17 18:01:47,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:47,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:47,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:47,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8. 2023-02-17 18:01:47,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 288a300782b44ac82fa24ad0dbc7d7f8: 2023-02-17 18:01:47,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91. 2023-02-17 18:01:47,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3eb86a4406fc57484a9d5a7ea1f24c91: 2023-02-17 18:01:47,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:47,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:47,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 87ac265a19634ca6fe96a4aabe2d8607, disabling compactions & flushes 2023-02-17 18:01:47,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:47,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:47,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. after waiting 0 ms 2023-02-17 18:01:47,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:47,165 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3eb86a4406fc57484a9d5a7ea1f24c91, regionState=CLOSED 2023-02-17 18:01:47,165 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907165"}]},"ts":"1676656907165"} 2023-02-17 18:01:47,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:47,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:47,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4fd0627db9cbe09e51eb5748fc382373, disabling compactions & flushes 2023-02-17 18:01:47,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:47,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:47,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. after waiting 0 ms 2023-02-17 18:01:47,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:47,165 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=288a300782b44ac82fa24ad0dbc7d7f8, regionState=CLOSED 2023-02-17 18:01:47,166 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907165"}]},"ts":"1676656907165"} 2023-02-17 18:01:47,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-17 18:01:47,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 3eb86a4406fc57484a9d5a7ea1f24c91, server=jenkins-hbase4.apache.org,43317,1676656902495 in 156 msec 2023-02-17 18:01:47,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=36 2023-02-17 18:01:47,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=36, state=SUCCESS; CloseRegionProcedure 288a300782b44ac82fa24ad0dbc7d7f8, server=jenkins-hbase4.apache.org,40377,1676656902457 in 163 msec 2023-02-17 18:01:47,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3eb86a4406fc57484a9d5a7ea1f24c91, UNASSIGN in 169 msec 2023-02-17 18:01:47,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=288a300782b44ac82fa24ad0dbc7d7f8, UNASSIGN in 170 msec 2023-02-17 18:01:47,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:47,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373. 2023-02-17 18:01:47,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4fd0627db9cbe09e51eb5748fc382373: 2023-02-17 18:01:47,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:47,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:47,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6ae3ca2c1acd14792eb5295cd5402e83, disabling compactions & flushes 2023-02-17 18:01:47,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:47,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:47,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. after waiting 0 ms 2023-02-17 18:01:47,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:47,173 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4fd0627db9cbe09e51eb5748fc382373, regionState=CLOSED 2023-02-17 18:01:47,173 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907173"}]},"ts":"1676656907173"} 2023-02-17 18:01:47,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-17 18:01:47,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 4fd0627db9cbe09e51eb5748fc382373, server=jenkins-hbase4.apache.org,40377,1676656902457 in 165 msec 2023-02-17 18:01:47,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4fd0627db9cbe09e51eb5748fc382373, UNASSIGN in 176 msec 2023-02-17 18:01:47,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:47,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607. 2023-02-17 18:01:47,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 87ac265a19634ca6fe96a4aabe2d8607: 2023-02-17 18:01:47,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:47,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:47,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1ecdb84e325d1a1f1bf4c4fde38c5ae6, disabling compactions & flushes 2023-02-17 18:01:47,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:47,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:47,183 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=87ac265a19634ca6fe96a4aabe2d8607, regionState=CLOSED 2023-02-17 18:01:47,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. after waiting 0 ms 2023-02-17 18:01:47,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:47,183 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907183"}]},"ts":"1676656907183"} 2023-02-17 18:01:47,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:47,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83. 2023-02-17 18:01:47,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6ae3ca2c1acd14792eb5295cd5402e83: 2023-02-17 18:01:47,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 18:01:47,189 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-17 18:01:47,189 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 87ac265a19634ca6fe96a4aabe2d8607, server=jenkins-hbase4.apache.org,43317,1676656902495 in 172 msec 2023-02-17 18:01:47,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6. 2023-02-17 18:01:47,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1ecdb84e325d1a1f1bf4c4fde38c5ae6: 2023-02-17 18:01:47,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:47,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:47,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a5821f8d4d4b563b416976e7cac4c5c1, disabling compactions & flushes 2023-02-17 18:01:47,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:47,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:47,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. after waiting 0 ms 2023-02-17 18:01:47,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:47,190 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6ae3ca2c1acd14792eb5295cd5402e83, regionState=CLOSED 2023-02-17 18:01:47,190 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907190"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907190"}]},"ts":"1676656907190"} 2023-02-17 18:01:47,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=87ac265a19634ca6fe96a4aabe2d8607, UNASSIGN in 190 msec 2023-02-17 18:01:47,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:47,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:47,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 97e3bb502cfdc46374faac1936b51422, disabling compactions & flushes 2023-02-17 18:01:47,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:47,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:47,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. after waiting 0 ms 2023-02-17 18:01:47,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:47,191 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=1ecdb84e325d1a1f1bf4c4fde38c5ae6, regionState=CLOSED 2023-02-17 18:01:47,191 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656907191"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907191"}]},"ts":"1676656907191"} 2023-02-17 18:01:47,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-17 18:01:47,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 6ae3ca2c1acd14792eb5295cd5402e83, server=jenkins-hbase4.apache.org,40377,1676656902457 in 175 msec 2023-02-17 18:01:47,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:47,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422. 2023-02-17 18:01:47,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 97e3bb502cfdc46374faac1936b51422: 2023-02-17 18:01:47,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-17 18:01:47,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1. 2023-02-17 18:01:47,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a5821f8d4d4b563b416976e7cac4c5c1: 2023-02-17 18:01:47,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-17 18:01:47,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 1ecdb84e325d1a1f1bf4c4fde38c5ae6, server=jenkins-hbase4.apache.org,43317,1676656902495 in 188 msec 2023-02-17 18:01:47,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:47,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:47,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 952edab40cfee0885d2a7504c18c0baa, disabling compactions & flushes 2023-02-17 18:01:47,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:47,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:47,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. after waiting 0 ms 2023-02-17 18:01:47,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:47,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6ae3ca2c1acd14792eb5295cd5402e83, UNASSIGN in 196 msec 2023-02-17 18:01:47,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=97e3bb502cfdc46374faac1936b51422, regionState=CLOSED 2023-02-17 18:01:47,199 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907199"}]},"ts":"1676656907199"} 2023-02-17 18:01:47,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:47,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:47,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d7518835bdc62d8a5afef2b993a037dc, disabling compactions & flushes 2023-02-17 18:01:47,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:47,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:47,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. after waiting 0 ms 2023-02-17 18:01:47,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:47,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1ecdb84e325d1a1f1bf4c4fde38c5ae6, UNASSIGN in 199 msec 2023-02-17 18:01:47,199 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=a5821f8d4d4b563b416976e7cac4c5c1, regionState=CLOSED 2023-02-17 18:01:47,199 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676656907199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907199"}]},"ts":"1676656907199"} 2023-02-17 18:01:47,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=35 2023-02-17 18:01:47,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=35, state=SUCCESS; CloseRegionProcedure 97e3bb502cfdc46374faac1936b51422, server=jenkins-hbase4.apache.org,43317,1676656902495 in 194 msec 2023-02-17 18:01:47,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=97e3bb502cfdc46374faac1936b51422, UNASSIGN in 203 msec 2023-02-17 18:01:47,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=34 2023-02-17 18:01:47,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=34, state=SUCCESS; CloseRegionProcedure a5821f8d4d4b563b416976e7cac4c5c1, server=jenkins-hbase4.apache.org,40377,1676656902457 in 197 msec 2023-02-17 18:01:47,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=a5821f8d4d4b563b416976e7cac4c5c1, UNASSIGN in 207 msec 2023-02-17 18:01:47,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:47,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:47,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa. 2023-02-17 18:01:47,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 952edab40cfee0885d2a7504c18c0baa: 2023-02-17 18:01:47,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc. 2023-02-17 18:01:47,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d7518835bdc62d8a5afef2b993a037dc: 2023-02-17 18:01:47,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:47,210 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=952edab40cfee0885d2a7504c18c0baa, regionState=CLOSED 2023-02-17 18:01:47,210 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907210"}]},"ts":"1676656907210"} 2023-02-17 18:01:47,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:47,211 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d7518835bdc62d8a5afef2b993a037dc, regionState=CLOSED 2023-02-17 18:01:47,211 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676656907211"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656907211"}]},"ts":"1676656907211"} 2023-02-17 18:01:47,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=37 2023-02-17 18:01:47,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=37, state=SUCCESS; CloseRegionProcedure 952edab40cfee0885d2a7504c18c0baa, server=jenkins-hbase4.apache.org,43317,1676656902495 in 208 msec 2023-02-17 18:01:47,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-17 18:01:47,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=952edab40cfee0885d2a7504c18c0baa, UNASSIGN in 214 msec 2023-02-17 18:01:47,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure d7518835bdc62d8a5afef2b993a037dc, server=jenkins-hbase4.apache.org,40377,1676656902457 in 202 msec 2023-02-17 18:01:47,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-17 18:01:47,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d7518835bdc62d8a5afef2b993a037dc, UNASSIGN in 215 msec 2023-02-17 18:01:47,216 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656907215"}]},"ts":"1676656907215"} 2023-02-17 18:01:47,217 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-17 18:01:47,218 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-17 18:01:47,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 230 msec 2023-02-17 18:01:47,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-17 18:01:47,297 INFO [Listener at localhost/34907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-17 18:01:47,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-17 18:01:47,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:47,301 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:47,301 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:47,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 18:01:47,316 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:47,316 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:47,316 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:47,316 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:47,316 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:47,316 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:47,316 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:47,316 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:47,324 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/recovered.edits] 2023-02-17 18:01:47,326 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/recovered.edits] 2023-02-17 18:01:47,327 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/recovered.edits] 2023-02-17 18:01:47,327 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/recovered.edits] 2023-02-17 18:01:47,327 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/recovered.edits] 2023-02-17 18:01:47,327 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/recovered.edits] 2023-02-17 18:01:47,328 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/recovered.edits] 2023-02-17 18:01:47,331 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/recovered.edits] 2023-02-17 18:01:47,341 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/39856a28794e44c88832b931b16f14e9 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/39856a28794e44c88832b931b16f14e9 2023-02-17 18:01:47,341 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/332f4f44c7ff4f33aa29c82bbd42bb11 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/332f4f44c7ff4f33aa29c82bbd42bb11 2023-02-17 18:01:47,341 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/c1f9727f871b4573888f4ec7092ef51a to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/c1f9727f871b4573888f4ec7092ef51a 2023-02-17 18:01:47,342 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/5a01ca1cd2a843f5b9295c99882c5111 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/5a01ca1cd2a843f5b9295c99882c5111 2023-02-17 18:01:47,343 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/5d91c349fc524669a80fb50ecff26ff5 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/5d91c349fc524669a80fb50ecff26ff5 2023-02-17 18:01:47,344 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/53a6adef23a9493bb6de7ac504649193 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f1/53a6adef23a9493bb6de7ac504649193 2023-02-17 18:01:47,345 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/5e76f7e2443448f5a04209675153420d to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f1/5e76f7e2443448f5a04209675153420d 2023-02-17 18:01:47,345 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/dec57d23a880488aa4856c08d4e3dba8 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f1/dec57d23a880488aa4856c08d4e3dba8 2023-02-17 18:01:47,345 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/68f9d9d397d94a8da1de7fed44539402 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/68f9d9d397d94a8da1de7fed44539402 2023-02-17 18:01:47,345 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/c873bd1a80184f65a0f1c536e5105a16 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f1/c873bd1a80184f65a0f1c536e5105a16 2023-02-17 18:01:47,346 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/45d0e1f7a71746e68417205dd2635d76 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/45d0e1f7a71746e68417205dd2635d76 2023-02-17 18:01:47,347 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/recovered.edits/6.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1/recovered.edits/6.seqid 2023-02-17 18:01:47,348 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/a5821f8d4d4b563b416976e7cac4c5c1 2023-02-17 18:01:47,348 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:47,348 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/e7f7959f3980425d97e1a34b9bd487fb to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f1/e7f7959f3980425d97e1a34b9bd487fb 2023-02-17 18:01:47,348 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/cc6f2c9adf684e3d9e6812339c874828 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f1/cc6f2c9adf684e3d9e6812339c874828 2023-02-17 18:01:47,352 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/aef2e21a175c49c682e46de5da5e5b9b to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f1/aef2e21a175c49c682e46de5da5e5b9b 2023-02-17 18:01:47,354 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/17194578853e49e18e08875cb34aaedc to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/17194578853e49e18e08875cb34aaedc 2023-02-17 18:01:47,354 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/recovered.edits] 2023-02-17 18:01:47,354 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/1dbee9dae9764128ac2ab2f98edc0c08 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/1dbee9dae9764128ac2ab2f98edc0c08 2023-02-17 18:01:47,355 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/6be1e4cd210c4164ae276b81b8742320 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/6be1e4cd210c4164ae276b81b8742320 2023-02-17 18:01:47,355 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/0f4349634bf845218d662777a085f271 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/0f4349634bf845218d662777a085f271 2023-02-17 18:01:47,360 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/a7dfd1553bf34d05a99bae8eb76ad121 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/f2/a7dfd1553bf34d05a99bae8eb76ad121 2023-02-17 18:01:47,363 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/b4e495dcf4584694ad3cd0c1ab21f241 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/f2/b4e495dcf4584694ad3cd0c1ab21f241 2023-02-17 18:01:47,364 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/b699c81541ee43dcbc0d29ff353042f4 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/f2/b699c81541ee43dcbc0d29ff353042f4 2023-02-17 18:01:47,365 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/953c76ab50784139a131e0c2ba4a965b to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/f2/953c76ab50784139a131e0c2ba4a965b 2023-02-17 18:01:47,367 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/54bc6d911f1f4e26918a7ba767c3b829 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/54bc6d911f1f4e26918a7ba767c3b829 2023-02-17 18:01:47,368 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/0664d4ba5bed4f439724cef0f02d880d to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/0664d4ba5bed4f439724cef0f02d880d 2023-02-17 18:01:47,369 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/3b31ab632b2d4758b15624fdaa92140b to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/3b31ab632b2d4758b15624fdaa92140b 2023-02-17 18:01:47,370 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/dd5fd05f760343c482c9318351fa5c44 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/f2/dd5fd05f760343c482c9318351fa5c44 2023-02-17 18:01:47,371 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/34a24a35ab9a4d4dbc16fb6635dfc3ea to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/34a24a35ab9a4d4dbc16fb6635dfc3ea 2023-02-17 18:01:47,372 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/2d67a3f94ae747e6abbeff02015fd8de to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/f2/2d67a3f94ae747e6abbeff02015fd8de 2023-02-17 18:01:47,372 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/recovered.edits/12.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91/recovered.edits/12.seqid 2023-02-17 18:01:47,375 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/recovered.edits/12.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa/recovered.edits/12.seqid 2023-02-17 18:01:47,375 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/3eb86a4406fc57484a9d5a7ea1f24c91 2023-02-17 18:01:47,376 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:47,376 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/recovered.edits/12.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8/recovered.edits/12.seqid 2023-02-17 18:01:47,376 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/542a0b300a564913985cfa4ea4dd0d33 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/f2/542a0b300a564913985cfa4ea4dd0d33 2023-02-17 18:01:47,377 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/952edab40cfee0885d2a7504c18c0baa 2023-02-17 18:01:47,377 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/288a300782b44ac82fa24ad0dbc7d7f8 2023-02-17 18:01:47,377 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/96542bb291324fdcb32596c282268118 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f1/96542bb291324fdcb32596c282268118 2023-02-17 18:01:47,377 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/recovered.edits/12.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc/recovered.edits/12.seqid 2023-02-17 18:01:47,378 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/d7518835bdc62d8a5afef2b993a037dc 2023-02-17 18:01:47,379 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/recovered.edits/12.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83/recovered.edits/12.seqid 2023-02-17 18:01:47,380 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/f1, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/f2, FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/recovered.edits] 2023-02-17 18:01:47,380 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/recovered.edits/12.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422/recovered.edits/12.seqid 2023-02-17 18:01:47,381 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/6ae3ca2c1acd14792eb5295cd5402e83 2023-02-17 18:01:47,381 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/97e3bb502cfdc46374faac1936b51422 2023-02-17 18:01:47,382 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/recovered.edits/12.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607/recovered.edits/12.seqid 2023-02-17 18:01:47,383 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/0a1724ff6db64779926660cb84f2a9d0 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/0a1724ff6db64779926660cb84f2a9d0 2023-02-17 18:01:47,383 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/87ac265a19634ca6fe96a4aabe2d8607 2023-02-17 18:01:47,384 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/60569763900641b0a389db6a4b2c7488 to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/f2/60569763900641b0a389db6a4b2c7488 2023-02-17 18:01:47,387 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/recovered.edits/6.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6/recovered.edits/6.seqid 2023-02-17 18:01:47,387 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/1ecdb84e325d1a1f1bf4c4fde38c5ae6 2023-02-17 18:01:47,388 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/recovered.edits/12.seqid to hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/archive/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373/recovered.edits/12.seqid 2023-02-17 18:01:47,388 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/.tmp/data/default/testWithMockedMapReduceMultiRegion/4fd0627db9cbe09e51eb5748fc382373 2023-02-17 18:01:47,388 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-17 18:01:47,391 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:47,393 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-17 18:01:47,396 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,397 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656907397"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,399 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-17 18:01:47,399 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a5821f8d4d4b563b416976e7cac4c5c1, NAME => 'testWithMockedMapReduceMultiRegion,,1676656903647.a5821f8d4d4b563b416976e7cac4c5c1.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 97e3bb502cfdc46374faac1936b51422, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676656903647.97e3bb502cfdc46374faac1936b51422.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 288a300782b44ac82fa24ad0dbc7d7f8, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676656903647.288a300782b44ac82fa24ad0dbc7d7f8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 952edab40cfee0885d2a7504c18c0baa, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676656903647.952edab40cfee0885d2a7504c18c0baa.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 6ae3ca2c1acd14792eb5295cd5402e83, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676656903647.6ae3ca2c1acd14792eb5295cd5402e83.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 87ac265a19634ca6fe96a4aabe2d8607, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676656903647.87ac265a19634ca6fe96a4aabe2d8607.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => d7518835bdc62d8a5afef2b993a037dc, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676656903647.d7518835bdc62d8a5afef2b993a037dc.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 3eb86a4406fc57484a9d5a7ea1f24c91, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676656903647.3eb86a4406fc57484a9d5a7ea1f24c91.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 4fd0627db9cbe09e51eb5748fc382373, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676656903647.4fd0627db9cbe09e51eb5748fc382373.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 1ecdb84e325d1a1f1bf4c4fde38c5ae6, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676656903647.1ecdb84e325d1a1f1bf4c4fde38c5ae6.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-17 18:01:47,399 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-17 18:01:47,400 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676656907399"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:47,401 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-17 18:01:47,403 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-17 18:01:47,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 18:01:47,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 105 msec 2023-02-17 18:01:47,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35453] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-17 18:01:47,605 INFO [Listener at localhost/34907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-17 18:01:47,605 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 18:01:47,606 INFO [Listener at localhost/34907] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 18:01:47,606 DEBUG [Listener at localhost/34907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x258dc021 to 127.0.0.1:64475 2023-02-17 18:01:47,606 DEBUG [Listener at localhost/34907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:47,606 DEBUG [Listener at localhost/34907] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 18:01:47,606 DEBUG [Listener at localhost/34907] util.JVMClusterUtil(257): Found active master hash=1968447723, stopped=false 2023-02-17 18:01:47,606 INFO [Listener at localhost/34907] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:47,609 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:47,609 INFO [Listener at localhost/34907] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 18:01:47,609 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:47,609 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:47,609 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:47,610 DEBUG [Listener at localhost/34907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0610c88c to 127.0.0.1:64475 2023-02-17 18:01:47,611 DEBUG [Listener at localhost/34907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:47,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:47,611 INFO [Listener at localhost/34907] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40377,1676656902457' ***** 2023-02-17 18:01:47,611 INFO [Listener at localhost/34907] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:47,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:47,611 INFO [Listener at localhost/34907] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43317,1676656902495' ***** 2023-02-17 18:01:47,611 INFO [RS:0;jenkins-hbase4:40377] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:47,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:47,611 INFO [RS:0;jenkins-hbase4:40377] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:47,611 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:47,611 INFO [Listener at localhost/34907] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:47,611 INFO [RS:0;jenkins-hbase4:40377] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:47,612 INFO [RS:1;jenkins-hbase4:43317] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:47,612 INFO [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:47,612 INFO [RS:1;jenkins-hbase4:43317] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:47,612 DEBUG [RS:0;jenkins-hbase4:40377] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36404c9f to 127.0.0.1:64475 2023-02-17 18:01:47,612 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:47,613 DEBUG [RS:0;jenkins-hbase4:40377] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:47,613 INFO [RS:1;jenkins-hbase4:43317] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:47,613 INFO [RS:0;jenkins-hbase4:40377] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:47,614 INFO [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(3304): Received CLOSE for 41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:47,614 INFO [RS:0;jenkins-hbase4:40377] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:47,614 INFO [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:47,614 INFO [RS:0;jenkins-hbase4:40377] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:47,614 DEBUG [RS:1;jenkins-hbase4:43317] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54d154f0 to 127.0.0.1:64475 2023-02-17 18:01:47,614 INFO [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 18:01:47,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 41d0f939a7e3ba862dd99b53cf8a9a17, disabling compactions & flushes 2023-02-17 18:01:47,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:47,614 DEBUG [RS:1;jenkins-hbase4:43317] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:47,614 INFO [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 18:01:47,614 INFO [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 18:01:47,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:47,615 DEBUG [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1479): Online Regions={41d0f939a7e3ba862dd99b53cf8a9a17=hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17.} 2023-02-17 18:01:47,614 DEBUG [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-17 18:01:47,616 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:47,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. after waiting 0 ms 2023-02-17 18:01:47,617 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:47,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:47,617 DEBUG [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 18:01:47,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 41d0f939a7e3ba862dd99b53cf8a9a17 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 18:01:47,617 DEBUG [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1505): Waiting on 41d0f939a7e3ba862dd99b53cf8a9a17 2023-02-17 18:01:47,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:47,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:47,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:47,617 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-17 18:01:47,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17/.tmp/info/ad5977b13ce241f982c6adec309f9d98 2023-02-17 18:01:47,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/.tmp/info/587eb87ac4d445f8be09670defa9f5a9 2023-02-17 18:01:47,637 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:47,639 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:47,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17/.tmp/info/ad5977b13ce241f982c6adec309f9d98 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17/info/ad5977b13ce241f982c6adec309f9d98 2023-02-17 18:01:47,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 587eb87ac4d445f8be09670defa9f5a9 2023-02-17 18:01:47,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17/info/ad5977b13ce241f982c6adec309f9d98, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 18:01:47,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 41d0f939a7e3ba862dd99b53cf8a9a17 in 34ms, sequenceid=6, compaction requested=false 2023-02-17 18:01:47,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/namespace/41d0f939a7e3ba862dd99b53cf8a9a17/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 18:01:47,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:47,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 41d0f939a7e3ba862dd99b53cf8a9a17: 2023-02-17 18:01:47,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676656903134.41d0f939a7e3ba862dd99b53cf8a9a17. 2023-02-17 18:01:47,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/.tmp/rep_barrier/e51eef5c364c4e7da66cefda1b754933 2023-02-17 18:01:47,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e51eef5c364c4e7da66cefda1b754933 2023-02-17 18:01:47,685 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/.tmp/table/8d2980d1bd9e4025843d2ff247518c53 2023-02-17 18:01:47,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d2980d1bd9e4025843d2ff247518c53 2023-02-17 18:01:47,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/.tmp/info/587eb87ac4d445f8be09670defa9f5a9 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/info/587eb87ac4d445f8be09670defa9f5a9 2023-02-17 18:01:47,692 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 587eb87ac4d445f8be09670defa9f5a9 2023-02-17 18:01:47,692 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/info/587eb87ac4d445f8be09670defa9f5a9, entries=30, sequenceid=57, filesize=8.3 K 2023-02-17 18:01:47,692 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/.tmp/rep_barrier/e51eef5c364c4e7da66cefda1b754933 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/rep_barrier/e51eef5c364c4e7da66cefda1b754933 2023-02-17 18:01:47,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e51eef5c364c4e7da66cefda1b754933 2023-02-17 18:01:47,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/rep_barrier/e51eef5c364c4e7da66cefda1b754933, entries=10, sequenceid=57, filesize=6.1 K 2023-02-17 18:01:47,696 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/.tmp/table/8d2980d1bd9e4025843d2ff247518c53 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/table/8d2980d1bd9e4025843d2ff247518c53 2023-02-17 18:01:47,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8d2980d1bd9e4025843d2ff247518c53 2023-02-17 18:01:47,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/table/8d2980d1bd9e4025843d2ff247518c53, entries=13, sequenceid=57, filesize=6.1 K 2023-02-17 18:01:47,700 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 83ms, sequenceid=57, compaction requested=false 2023-02-17 18:01:47,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-17 18:01:47,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 18:01:47,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:47,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:47,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:47,817 INFO [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40377,1676656902457; all regions closed. 2023-02-17 18:01:47,817 INFO [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43317,1676656902495; all regions closed. 2023-02-17 18:01:47,824 DEBUG [RS:1;jenkins-hbase4:43317] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/oldWALs 2023-02-17 18:01:47,824 DEBUG [RS:0;jenkins-hbase4:40377] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/oldWALs 2023-02-17 18:01:47,824 INFO [RS:0;jenkins-hbase4:40377] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40377%2C1676656902457.meta:.meta(num 1676656903077) 2023-02-17 18:01:47,824 INFO [RS:1;jenkins-hbase4:43317] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43317%2C1676656902495:(num 1676656903489) 2023-02-17 18:01:47,824 DEBUG [RS:1;jenkins-hbase4:43317] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:47,824 INFO [RS:1;jenkins-hbase4:43317] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:47,824 INFO [RS:1;jenkins-hbase4:43317] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:47,824 INFO [RS:1;jenkins-hbase4:43317] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:47,824 INFO [RS:1;jenkins-hbase4:43317] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:47,824 INFO [RS:1;jenkins-hbase4:43317] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:47,825 INFO [RS:1;jenkins-hbase4:43317] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43317 2023-02-17 18:01:47,825 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:47,827 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/WALs/jenkins-hbase4.apache.org,40377,1676656902457/jenkins-hbase4.apache.org%2C40377%2C1676656902457.1676656903863 not finished, retry = 0 2023-02-17 18:01:47,827 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:47,827 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:47,827 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43317,1676656902495 2023-02-17 18:01:47,827 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:47,827 ERROR [Listener at localhost/34907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e6c2734 rejected from java.util.concurrent.ThreadPoolExecutor@3a53b421[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:47,827 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:47,827 ERROR [Listener at localhost/34907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@116e34e3 rejected from java.util.concurrent.ThreadPoolExecutor@3a53b421[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:47,827 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43317,1676656902495] 2023-02-17 18:01:47,828 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43317,1676656902495; numProcessing=1 2023-02-17 18:01:47,829 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43317,1676656902495 already deleted, retry=false 2023-02-17 18:01:47,829 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43317,1676656902495 expired; onlineServers=1 2023-02-17 18:01:47,840 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 18:01:47,841 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 18:01:47,929 DEBUG [RS:0;jenkins-hbase4:40377] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/oldWALs 2023-02-17 18:01:47,929 INFO [RS:0;jenkins-hbase4:40377] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40377%2C1676656902457:(num 1676656903863) 2023-02-17 18:01:47,929 DEBUG [RS:0;jenkins-hbase4:40377] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:47,929 INFO [RS:0;jenkins-hbase4:40377] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:47,929 INFO [RS:0;jenkins-hbase4:40377] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:47,929 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:47,931 INFO [RS:0;jenkins-hbase4:40377] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40377 2023-02-17 18:01:47,933 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40377,1676656902457 2023-02-17 18:01:47,933 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:47,933 ERROR [Listener at localhost/34907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73eea658 rejected from java.util.concurrent.ThreadPoolExecutor@77d12cfd[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:47,934 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40377,1676656902457] 2023-02-17 18:01:47,934 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40377,1676656902457; numProcessing=2 2023-02-17 18:01:47,935 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40377,1676656902457 already deleted, retry=false 2023-02-17 18:01:47,935 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40377,1676656902457 expired; onlineServers=0 2023-02-17 18:01:47,936 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35453,1676656902397' ***** 2023-02-17 18:01:47,936 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 18:01:47,936 DEBUG [M:0;jenkins-hbase4:35453] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@716baa99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:47,936 INFO [M:0;jenkins-hbase4:35453] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35453,1676656902397 2023-02-17 18:01:47,936 INFO [M:0;jenkins-hbase4:35453] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35453,1676656902397; all regions closed. 2023-02-17 18:01:47,936 DEBUG [M:0;jenkins-hbase4:35453] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:47,936 DEBUG [M:0;jenkins-hbase4:35453] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 18:01:47,936 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 18:01:47,936 DEBUG [M:0;jenkins-hbase4:35453] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 18:01:47,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656902693] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656902693,5,FailOnTimeoutGroup] 2023-02-17 18:01:47,937 INFO [M:0;jenkins-hbase4:35453] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 18:01:47,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656902692] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656902692,5,FailOnTimeoutGroup] 2023-02-17 18:01:47,937 INFO [M:0;jenkins-hbase4:35453] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 18:01:47,938 INFO [M:0;jenkins-hbase4:35453] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 18:01:47,938 DEBUG [M:0;jenkins-hbase4:35453] master.HMaster(1512): Stopping service threads 2023-02-17 18:01:47,938 INFO [M:0;jenkins-hbase4:35453] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 18:01:47,938 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:47,938 ERROR [M:0;jenkins-hbase4:35453] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 18:01:47,938 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:47,939 INFO [M:0;jenkins-hbase4:35453] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 18:01:47,939 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 18:01:47,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:47,939 DEBUG [M:0;jenkins-hbase4:35453] zookeeper.ZKUtil(398): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 18:01:47,939 WARN [M:0;jenkins-hbase4:35453] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 18:01:47,939 INFO [M:0;jenkins-hbase4:35453] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 18:01:47,939 INFO [M:0;jenkins-hbase4:35453] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 18:01:47,940 DEBUG [M:0;jenkins-hbase4:35453] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:47,940 INFO [M:0;jenkins-hbase4:35453] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:47,940 DEBUG [M:0;jenkins-hbase4:35453] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:47,940 DEBUG [M:0;jenkins-hbase4:35453] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:47,940 DEBUG [M:0;jenkins-hbase4:35453] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:47,940 INFO [M:0;jenkins-hbase4:35453] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.13 KB heapSize=200.04 KB 2023-02-17 18:01:47,948 INFO [M:0;jenkins-hbase4:35453] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.13 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0ff13cda62f1491eb1adf34aab80ede4 2023-02-17 18:01:47,952 DEBUG [M:0;jenkins-hbase4:35453] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0ff13cda62f1491eb1adf34aab80ede4 as hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0ff13cda62f1491eb1adf34aab80ede4 2023-02-17 18:01:47,956 INFO [M:0;jenkins-hbase4:35453] regionserver.HStore(1080): Added hdfs://localhost:43825/user/jenkins/test-data/4cbac1d7-17a9-d842-cf46-d850c36d5fff/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0ff13cda62f1491eb1adf34aab80ede4, entries=53, sequenceid=357, filesize=10.7 K 2023-02-17 18:01:47,957 INFO [M:0;jenkins-hbase4:35453] regionserver.HRegion(2947): Finished flush of dataSize ~167.13 KB/171142, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-17 18:01:47,958 INFO [M:0;jenkins-hbase4:35453] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:47,958 DEBUG [M:0;jenkins-hbase4:35453] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:47,961 INFO [M:0;jenkins-hbase4:35453] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 18:01:47,961 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:47,963 INFO [M:0;jenkins-hbase4:35453] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35453 2023-02-17 18:01:47,967 DEBUG [M:0;jenkins-hbase4:35453] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35453,1676656902397 already deleted, retry=false 2023-02-17 18:01:48,109 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:48,109 INFO [M:0;jenkins-hbase4:35453] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35453,1676656902397; zookeeper connection closed. 2023-02-17 18:01:48,109 ERROR [Listener at localhost/34907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b96595 rejected from java.util.concurrent.ThreadPoolExecutor@286f19a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:48,110 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): master:35453-0x1006371ea9b0000, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:48,110 ERROR [Listener at localhost/34907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3bd1147e rejected from java.util.concurrent.ThreadPoolExecutor@286f19a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:48,209 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:48,209 INFO [RS:0;jenkins-hbase4:40377] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40377,1676656902457; zookeeper connection closed. 2023-02-17 18:01:48,209 ERROR [Listener at localhost/34907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@571909b rejected from java.util.concurrent.ThreadPoolExecutor@77d12cfd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:48,210 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:40377-0x1006371ea9b0001, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:48,210 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1ff95720] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1ff95720 2023-02-17 18:01:48,210 ERROR [Listener at localhost/34907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7de35847 rejected from java.util.concurrent.ThreadPoolExecutor@77d12cfd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:48,309 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:48,309 INFO [RS:1;jenkins-hbase4:43317] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43317,1676656902495; zookeeper connection closed. 2023-02-17 18:01:48,310 ERROR [Listener at localhost/34907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6931b33c rejected from java.util.concurrent.ThreadPoolExecutor@3a53b421[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:48,310 DEBUG [Listener at localhost/34907-EventThread] zookeeper.ZKWatcher(600): regionserver:43317-0x1006371ea9b0002, quorum=127.0.0.1:64475, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:48,310 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5603e339] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5603e339 2023-02-17 18:01:48,310 ERROR [Listener at localhost/34907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f573460 rejected from java.util.concurrent.ThreadPoolExecutor@3a53b421[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:48,310 INFO [Listener at localhost/34907] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 18:01:48,311 WARN [Listener at localhost/34907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:48,314 INFO [Listener at localhost/34907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:48,341 WARN [BP-1810265748-172.31.14.131-1676656901726 heartbeating to localhost/127.0.0.1:43825] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1810265748-172.31.14.131-1676656901726 (Datanode Uuid af96a624-9e7b-4e63-92d3-7bfacf80cb0f) service to localhost/127.0.0.1:43825 2023-02-17 18:01:48,342 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/cluster_25ca2f20-097d-17db-5dc0-060b18adfe6b/dfs/data/data3/current/BP-1810265748-172.31.14.131-1676656901726] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:48,343 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/cluster_25ca2f20-097d-17db-5dc0-060b18adfe6b/dfs/data/data4/current/BP-1810265748-172.31.14.131-1676656901726] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:48,423 WARN [Listener at localhost/34907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:48,425 INFO [Listener at localhost/34907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:48,531 WARN [BP-1810265748-172.31.14.131-1676656901726 heartbeating to localhost/127.0.0.1:43825] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:48,532 WARN [BP-1810265748-172.31.14.131-1676656901726 heartbeating to localhost/127.0.0.1:43825] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1810265748-172.31.14.131-1676656901726 (Datanode Uuid 999abd99-1b6d-4d3d-b30c-bdaac1b4a624) service to localhost/127.0.0.1:43825 2023-02-17 18:01:48,535 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/cluster_25ca2f20-097d-17db-5dc0-060b18adfe6b/dfs/data/data1/current/BP-1810265748-172.31.14.131-1676656901726] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:48,535 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/cluster_25ca2f20-097d-17db-5dc0-060b18adfe6b/dfs/data/data2/current/BP-1810265748-172.31.14.131-1676656901726] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:48,545 INFO [Listener at localhost/34907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:48,663 INFO [Listener at localhost/34907] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 18:01:48,703 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 18:01:48,718 INFO [Listener at localhost/34907] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 181) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:43825 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:43825 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43825 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/34907 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43825 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43825 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43825 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,35453,1676656902397)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/34907.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:43825 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=634 (was 564) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=370 (was 385), ProcessCount=172 (was 172), AvailableMemoryMB=7110 (was 7155) 2023-02-17 18:01:48,728 INFO [Listener at localhost/34907] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=370, ProcessCount=172, AvailableMemoryMB=7109 2023-02-17 18:01:48,738 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/hadoop.log.dir so I do NOT create it in target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9 2023-02-17 18:01:48,739 WARN [Listener at localhost/34907] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 18:01:48,739 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/hadoop.tmp.dir so I do NOT create it in target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9 2023-02-17 18:01:48,739 WARN [Listener at localhost/34907] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2ee426e-005f-dd25-0e1e-e1f62a8af71f/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 18:01:48,739 DEBUG [Listener at localhost/34907] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9 2023-02-17 18:01:48,739 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 18:01:48,739 INFO [Listener at localhost/34907] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/cluster_ba35821f-d356-c5b9-9c66-97b05bc714d4, deleteOnExit=true 2023-02-17 18:01:48,739 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 18:01:48,739 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/test.cache.data in system properties and HBase conf 2023-02-17 18:01:48,739 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 18:01:48,739 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/hadoop.log.dir in system properties and HBase conf 2023-02-17 18:01:48,739 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 18:01:48,739 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 18:01:48,740 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 18:01:48,740 DEBUG [Listener at localhost/34907] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 18:01:48,740 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:48,740 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:48,740 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 18:01:48,740 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:48,740 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 18:01:48,740 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 18:01:48,740 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:48,741 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:48,741 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 18:01:48,741 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/nfs.dump.dir in system properties and HBase conf 2023-02-17 18:01:48,741 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/java.io.tmpdir in system properties and HBase conf 2023-02-17 18:01:48,741 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:48,741 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 18:01:48,741 INFO [Listener at localhost/34907] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 18:01:48,745 WARN [Listener at localhost/34907] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:48,745 WARN [Listener at localhost/34907] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:48,796 WARN [Listener at localhost/34907] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:48,799 INFO [Listener at localhost/34907] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:48,804 INFO [Listener at localhost/34907] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/java.io.tmpdir/Jetty_localhost_46119_hdfs____.vjgbgf/webapp 2023-02-17 18:01:48,897 INFO [Listener at localhost/34907] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46119 2023-02-17 18:01:48,899 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 18:01:48,902 WARN [Listener at localhost/34907] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:48,902 WARN [Listener at localhost/34907] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:48,945 WARN [Listener at localhost/36489] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:48,961 WARN [Listener at localhost/36489] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:48,963 WARN [Listener at localhost/36489] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:48,964 INFO [Listener at localhost/36489] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:48,971 INFO [Listener at localhost/36489] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/java.io.tmpdir/Jetty_localhost_38589_datanode____8ce9co/webapp 2023-02-17 18:01:49,087 INFO [Listener at localhost/36489] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38589 2023-02-17 18:01:49,094 WARN [Listener at localhost/46617] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:49,138 WARN [Listener at localhost/46617] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 18:01:49,225 WARN [Listener at localhost/46617] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:49,231 WARN [Listener at localhost/46617] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:49,232 INFO [Listener at localhost/46617] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:49,236 INFO [Listener at localhost/46617] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/java.io.tmpdir/Jetty_localhost_33465_datanode____.99qxom/webapp 2023-02-17 18:01:49,247 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6cbb78886ffcbe9b: Processing first storage report for DS-7773b02f-012a-492d-8577-ee10f69bc112 from datanode ba6b7e8f-c0fd-4109-bf82-ba581c79d41b 2023-02-17 18:01:49,247 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6cbb78886ffcbe9b: from storage DS-7773b02f-012a-492d-8577-ee10f69bc112 node DatanodeRegistration(127.0.0.1:46063, datanodeUuid=ba6b7e8f-c0fd-4109-bf82-ba581c79d41b, infoPort=45325, infoSecurePort=0, ipcPort=46617, storageInfo=lv=-57;cid=testClusterID;nsid=1661645141;c=1676656908747), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:49,247 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6cbb78886ffcbe9b: Processing first storage report for DS-eff6c94f-f066-453e-a464-f5a4cbc669a1 from datanode ba6b7e8f-c0fd-4109-bf82-ba581c79d41b 2023-02-17 18:01:49,247 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6cbb78886ffcbe9b: from storage DS-eff6c94f-f066-453e-a464-f5a4cbc669a1 node DatanodeRegistration(127.0.0.1:46063, datanodeUuid=ba6b7e8f-c0fd-4109-bf82-ba581c79d41b, infoPort=45325, infoSecurePort=0, ipcPort=46617, storageInfo=lv=-57;cid=testClusterID;nsid=1661645141;c=1676656908747), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:49,335 INFO [Listener at localhost/46617] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33465 2023-02-17 18:01:49,343 WARN [Listener at localhost/41669] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:49,440 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3c8fca51982b0584: Processing first storage report for DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e from datanode 26893791-b6f9-41f0-b502-44e5d9f3b750 2023-02-17 18:01:49,440 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3c8fca51982b0584: from storage DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e node DatanodeRegistration(127.0.0.1:37963, datanodeUuid=26893791-b6f9-41f0-b502-44e5d9f3b750, infoPort=39717, infoSecurePort=0, ipcPort=41669, storageInfo=lv=-57;cid=testClusterID;nsid=1661645141;c=1676656908747), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:49,440 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3c8fca51982b0584: Processing first storage report for DS-6710b994-281c-4e23-96f0-3f0df84635de from datanode 26893791-b6f9-41f0-b502-44e5d9f3b750 2023-02-17 18:01:49,440 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3c8fca51982b0584: from storage DS-6710b994-281c-4e23-96f0-3f0df84635de node DatanodeRegistration(127.0.0.1:37963, datanodeUuid=26893791-b6f9-41f0-b502-44e5d9f3b750, infoPort=39717, infoSecurePort=0, ipcPort=41669, storageInfo=lv=-57;cid=testClusterID;nsid=1661645141;c=1676656908747), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:49,449 DEBUG [Listener at localhost/41669] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9 2023-02-17 18:01:49,451 INFO [Listener at localhost/41669] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/cluster_ba35821f-d356-c5b9-9c66-97b05bc714d4/zookeeper_0, clientPort=58230, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/cluster_ba35821f-d356-c5b9-9c66-97b05bc714d4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/cluster_ba35821f-d356-c5b9-9c66-97b05bc714d4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 18:01:49,452 INFO [Listener at localhost/41669] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58230 2023-02-17 18:01:49,452 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,453 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,463 INFO [Listener at localhost/41669] util.FSUtils(479): Created version file at hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a with version=8 2023-02-17 18:01:49,463 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,464 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,465 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36489/user/jenkins/test-data/a1945e32-b854-0803-37a3-e0f37f9d2ddd/hbase-staging 2023-02-17 18:01:49,466 INFO [Listener at localhost/41669] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:49,467 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:49,467 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:49,467 INFO [Listener at localhost/41669] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:49,467 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:49,467 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:49,467 INFO [Listener at localhost/41669] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:49,468 INFO [Listener at localhost/41669] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38421 2023-02-17 18:01:49,468 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,469 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,469 INFO [Listener at localhost/41669] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38421 connecting to ZooKeeper ensemble=127.0.0.1:58230 2023-02-17 18:01:49,476 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:384210x0, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:49,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38421-0x1006372064f0000 connected 2023-02-17 18:01:49,497 DEBUG [Listener at localhost/41669] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:49,497 DEBUG [Listener at localhost/41669] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:49,498 DEBUG [Listener at localhost/41669] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:49,499 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38421 2023-02-17 18:01:49,499 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38421 2023-02-17 18:01:49,500 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38421 2023-02-17 18:01:49,500 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38421 2023-02-17 18:01:49,500 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38421 2023-02-17 18:01:49,501 INFO [Listener at localhost/41669] master.HMaster(444): hbase.rootdir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a, hbase.cluster.distributed=false 2023-02-17 18:01:49,514 INFO [Listener at localhost/41669] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:49,514 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:49,515 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:49,515 INFO [Listener at localhost/41669] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:49,515 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:49,515 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:49,515 INFO [Listener at localhost/41669] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:49,516 INFO [Listener at localhost/41669] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45571 2023-02-17 18:01:49,516 INFO [Listener at localhost/41669] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:49,519 DEBUG [Listener at localhost/41669] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:49,519 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,520 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,521 INFO [Listener at localhost/41669] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45571 connecting to ZooKeeper ensemble=127.0.0.1:58230 2023-02-17 18:01:49,527 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:455710x0, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:49,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45571-0x1006372064f0001 connected 2023-02-17 18:01:49,530 DEBUG [Listener at localhost/41669] zookeeper.ZKUtil(164): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:49,530 DEBUG [Listener at localhost/41669] zookeeper.ZKUtil(164): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:49,531 DEBUG [Listener at localhost/41669] zookeeper.ZKUtil(164): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:49,531 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45571 2023-02-17 18:01:49,532 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45571 2023-02-17 18:01:49,543 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45571 2023-02-17 18:01:49,543 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45571 2023-02-17 18:01:49,544 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45571 2023-02-17 18:01:49,559 INFO [Listener at localhost/41669] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:49,559 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:49,559 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:49,559 INFO [Listener at localhost/41669] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:49,559 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:49,559 INFO [Listener at localhost/41669] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:49,559 INFO [Listener at localhost/41669] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:49,560 INFO [Listener at localhost/41669] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38241 2023-02-17 18:01:49,560 INFO [Listener at localhost/41669] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:49,561 DEBUG [Listener at localhost/41669] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:49,561 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,562 INFO [Listener at localhost/41669] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,563 INFO [Listener at localhost/41669] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38241 connecting to ZooKeeper ensemble=127.0.0.1:58230 2023-02-17 18:01:49,571 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:382410x0, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:49,573 DEBUG [Listener at localhost/41669] zookeeper.ZKUtil(164): regionserver:382410x0, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:49,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38241-0x1006372064f0002 connected 2023-02-17 18:01:49,574 DEBUG [Listener at localhost/41669] zookeeper.ZKUtil(164): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:49,574 DEBUG [Listener at localhost/41669] zookeeper.ZKUtil(164): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:49,576 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38241 2023-02-17 18:01:49,576 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38241 2023-02-17 18:01:49,576 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38241 2023-02-17 18:01:49,580 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38241 2023-02-17 18:01:49,580 DEBUG [Listener at localhost/41669] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38241 2023-02-17 18:01:49,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:49,586 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:49,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:49,588 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:49,588 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:49,588 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:49,588 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:49,589 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:49,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38421,1676656909466 from backup master directory 2023-02-17 18:01:49,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:49,592 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:49,592 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:49,592 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:49,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:49,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/hbase.id with ID: 01646a97-5a31-44ff-93b2-4d080146d9f7 2023-02-17 18:01:49,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:49,629 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:49,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x43440909 to 127.0.0.1:58230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:49,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@80690c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:49,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:49,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 18:01:49,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:49,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/data/master/store-tmp 2023-02-17 18:01:49,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:49,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:49,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:49,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:49,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:49,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:49,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:49,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:49,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/WALs/jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:49,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38421%2C1676656909466, suffix=, logDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/WALs/jenkins-hbase4.apache.org,38421,1676656909466, archiveDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/oldWALs, maxLogs=10 2023-02-17 18:01:49,675 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46063,DS-7773b02f-012a-492d-8577-ee10f69bc112,DISK] 2023-02-17 18:01:49,675 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37963,DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e,DISK] 2023-02-17 18:01:49,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/WALs/jenkins-hbase4.apache.org,38421,1676656909466/jenkins-hbase4.apache.org%2C38421%2C1676656909466.1676656909658 2023-02-17 18:01:49,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37963,DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e,DISK], DatanodeInfoWithStorage[127.0.0.1:46063,DS-7773b02f-012a-492d-8577-ee10f69bc112,DISK]] 2023-02-17 18:01:49,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:49,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:49,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:49,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:49,684 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:49,685 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 18:01:49,686 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 18:01:49,686 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:49,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:49,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:49,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:49,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:49,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66191438, jitterRate=-0.01367071270942688}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:49,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:49,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 18:01:49,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 18:01:49,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 18:01:49,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 18:01:49,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 18:01:49,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 18:01:49,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 18:01:49,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 18:01:49,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 18:01:49,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 18:01:49,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 18:01:49,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 18:01:49,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 18:01:49,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 18:01:49,732 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:49,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 18:01:49,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 18:01:49,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 18:01:49,735 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:49,735 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:49,735 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:49,735 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:49,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38421,1676656909466, sessionid=0x1006372064f0000, setting cluster-up flag (Was=false) 2023-02-17 18:01:49,747 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:49,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 18:01:49,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:49,755 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:49,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 18:01:49,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:49,760 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.hbase-snapshot/.tmp 2023-02-17 18:01:49,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:49,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:49,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:49,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:49,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:49,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 18:01:49,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:49,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676656939763 2023-02-17 18:01:49,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 18:01:49,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 18:01:49,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 18:01:49,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 18:01:49,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 18:01:49,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 18:01:49,764 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:49,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,764 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 18:01:49,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 18:01:49,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 18:01:49,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 18:01:49,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 18:01:49,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 18:01:49,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656909765,5,FailOnTimeoutGroup] 2023-02-17 18:01:49,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656909765,5,FailOnTimeoutGroup] 2023-02-17 18:01:49,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,765 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:49,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 18:01:49,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,772 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:49,772 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:49,772 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a 2023-02-17 18:01:49,777 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:49,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:49,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/info 2023-02-17 18:01:49,779 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:49,779 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:49,779 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:49,780 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:49,781 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:49,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:49,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:49,782 INFO [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(952): ClusterId : 01646a97-5a31-44ff-93b2-4d080146d9f7 2023-02-17 18:01:49,782 INFO [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(952): ClusterId : 01646a97-5a31-44ff-93b2-4d080146d9f7 2023-02-17 18:01:49,782 DEBUG [RS:1;jenkins-hbase4:38241] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:49,782 DEBUG [RS:0;jenkins-hbase4:45571] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:49,783 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/table 2023-02-17 18:01:49,783 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:49,783 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:49,784 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740 2023-02-17 18:01:49,784 DEBUG [RS:0;jenkins-hbase4:45571] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:49,784 DEBUG [RS:1;jenkins-hbase4:38241] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:49,784 DEBUG [RS:1;jenkins-hbase4:38241] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:49,784 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740 2023-02-17 18:01:49,784 DEBUG [RS:0;jenkins-hbase4:45571] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:49,786 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:49,786 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:49,788 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:49,788 DEBUG [RS:1;jenkins-hbase4:38241] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:49,789 DEBUG [RS:1;jenkins-hbase4:38241] zookeeper.ReadOnlyZKClient(139): Connect 0x6170a5a8 to 127.0.0.1:58230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:49,789 DEBUG [RS:0;jenkins-hbase4:45571] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:49,789 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72889039, jitterRate=0.08613131940364838}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:49,790 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:49,791 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:49,791 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:49,791 DEBUG [RS:0;jenkins-hbase4:45571] zookeeper.ReadOnlyZKClient(139): Connect 0x39ed23c9 to 127.0.0.1:58230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:49,791 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:49,791 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:49,791 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:49,793 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:49,793 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:49,794 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:49,795 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 18:01:49,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 18:01:49,796 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 18:01:49,797 DEBUG [RS:1;jenkins-hbase4:38241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb757f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:49,797 DEBUG [RS:1;jenkins-hbase4:38241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b88ced8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:49,797 DEBUG [RS:0;jenkins-hbase4:45571] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@372aca84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:49,797 DEBUG [RS:0;jenkins-hbase4:45571] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@331548b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:49,797 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 18:01:49,805 DEBUG [RS:1;jenkins-hbase4:38241] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38241 2023-02-17 18:01:49,805 DEBUG [RS:0;jenkins-hbase4:45571] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45571 2023-02-17 18:01:49,805 INFO [RS:1;jenkins-hbase4:38241] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:49,805 INFO [RS:0;jenkins-hbase4:45571] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:49,805 INFO [RS:0;jenkins-hbase4:45571] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:49,805 INFO [RS:1;jenkins-hbase4:38241] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:49,805 DEBUG [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:49,805 DEBUG [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:49,806 INFO [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38421,1676656909466 with isa=jenkins-hbase4.apache.org/172.31.14.131:45571, startcode=1676656909514 2023-02-17 18:01:49,806 INFO [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38421,1676656909466 with isa=jenkins-hbase4.apache.org/172.31.14.131:38241, startcode=1676656909558 2023-02-17 18:01:49,806 DEBUG [RS:0;jenkins-hbase4:45571] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:49,806 DEBUG [RS:1;jenkins-hbase4:38241] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:49,808 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36795, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:49,808 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35993, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:49,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38421] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:49,809 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:49,810 DEBUG [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a 2023-02-17 18:01:49,810 DEBUG [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36489 2023-02-17 18:01:49,810 DEBUG [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:49,810 DEBUG [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a 2023-02-17 18:01:49,810 DEBUG [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36489 2023-02-17 18:01:49,810 DEBUG [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:49,811 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:49,818 DEBUG [RS:1;jenkins-hbase4:38241] zookeeper.ZKUtil(162): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:49,818 WARN [RS:1;jenkins-hbase4:38241] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:49,818 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38241,1676656909558] 2023-02-17 18:01:49,818 INFO [RS:1;jenkins-hbase4:38241] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:49,818 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45571,1676656909514] 2023-02-17 18:01:49,818 DEBUG [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/WALs/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:49,818 DEBUG [RS:0;jenkins-hbase4:45571] zookeeper.ZKUtil(162): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:49,818 WARN [RS:0;jenkins-hbase4:45571] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:49,818 INFO [RS:0;jenkins-hbase4:45571] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:49,818 DEBUG [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/WALs/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:49,824 DEBUG [RS:1;jenkins-hbase4:38241] zookeeper.ZKUtil(162): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:49,824 DEBUG [RS:0;jenkins-hbase4:45571] zookeeper.ZKUtil(162): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:49,824 DEBUG [RS:1;jenkins-hbase4:38241] zookeeper.ZKUtil(162): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:49,824 DEBUG [RS:0;jenkins-hbase4:45571] zookeeper.ZKUtil(162): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:49,825 DEBUG [RS:1;jenkins-hbase4:38241] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:49,825 DEBUG [RS:0;jenkins-hbase4:45571] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:49,825 INFO [RS:1;jenkins-hbase4:38241] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:49,825 INFO [RS:0;jenkins-hbase4:45571] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:49,826 INFO [RS:1;jenkins-hbase4:38241] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:49,826 INFO [RS:1;jenkins-hbase4:38241] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:49,826 INFO [RS:1;jenkins-hbase4:38241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,826 INFO [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:49,827 INFO [RS:0;jenkins-hbase4:45571] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:49,827 INFO [RS:1;jenkins-hbase4:38241] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,827 INFO [RS:0;jenkins-hbase4:45571] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:49,828 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,828 INFO [RS:0;jenkins-hbase4:45571] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,828 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,828 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,828 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,828 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,828 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:49,828 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,829 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,829 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,829 DEBUG [RS:1;jenkins-hbase4:38241] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,829 INFO [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:49,834 INFO [RS:1;jenkins-hbase4:38241] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,834 INFO [RS:0;jenkins-hbase4:45571] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,834 INFO [RS:1;jenkins-hbase4:38241] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,835 INFO [RS:1;jenkins-hbase4:38241] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,835 DEBUG [RS:0;jenkins-hbase4:45571] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:49,836 INFO [RS:0;jenkins-hbase4:45571] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,836 INFO [RS:0;jenkins-hbase4:45571] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,836 INFO [RS:0;jenkins-hbase4:45571] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,847 INFO [RS:1;jenkins-hbase4:38241] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:49,847 INFO [RS:0;jenkins-hbase4:45571] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:49,847 INFO [RS:1;jenkins-hbase4:38241] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38241,1676656909558-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,847 INFO [RS:0;jenkins-hbase4:45571] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45571,1676656909514-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:49,857 INFO [RS:1;jenkins-hbase4:38241] regionserver.Replication(203): jenkins-hbase4.apache.org,38241,1676656909558 started 2023-02-17 18:01:49,857 INFO [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38241,1676656909558, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38241, sessionid=0x1006372064f0002 2023-02-17 18:01:49,857 INFO [RS:0;jenkins-hbase4:45571] regionserver.Replication(203): jenkins-hbase4.apache.org,45571,1676656909514 started 2023-02-17 18:01:49,857 DEBUG [RS:1;jenkins-hbase4:38241] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:49,857 DEBUG [RS:1;jenkins-hbase4:38241] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:49,857 INFO [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45571,1676656909514, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45571, sessionid=0x1006372064f0001 2023-02-17 18:01:49,857 DEBUG [RS:1;jenkins-hbase4:38241] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38241,1676656909558' 2023-02-17 18:01:49,857 DEBUG [RS:0;jenkins-hbase4:45571] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:49,857 DEBUG [RS:0;jenkins-hbase4:45571] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:49,857 DEBUG [RS:1;jenkins-hbase4:38241] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:49,857 DEBUG [RS:0;jenkins-hbase4:45571] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45571,1676656909514' 2023-02-17 18:01:49,857 DEBUG [RS:0;jenkins-hbase4:45571] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:49,858 DEBUG [RS:1;jenkins-hbase4:38241] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:49,858 DEBUG [RS:0;jenkins-hbase4:45571] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:49,858 DEBUG [RS:1;jenkins-hbase4:38241] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:49,858 DEBUG [RS:1;jenkins-hbase4:38241] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:49,858 DEBUG [RS:1;jenkins-hbase4:38241] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:49,858 DEBUG [RS:1;jenkins-hbase4:38241] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38241,1676656909558' 2023-02-17 18:01:49,858 DEBUG [RS:1;jenkins-hbase4:38241] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:49,858 DEBUG [RS:0;jenkins-hbase4:45571] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:49,858 DEBUG [RS:0;jenkins-hbase4:45571] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:49,858 DEBUG [RS:0;jenkins-hbase4:45571] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:49,858 DEBUG [RS:0;jenkins-hbase4:45571] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45571,1676656909514' 2023-02-17 18:01:49,858 DEBUG [RS:0;jenkins-hbase4:45571] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:49,858 DEBUG [RS:1;jenkins-hbase4:38241] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:49,858 DEBUG [RS:0;jenkins-hbase4:45571] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:49,858 DEBUG [RS:1;jenkins-hbase4:38241] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:49,859 INFO [RS:1;jenkins-hbase4:38241] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:49,859 INFO [RS:1;jenkins-hbase4:38241] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:49,859 DEBUG [RS:0;jenkins-hbase4:45571] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:49,859 INFO [RS:0;jenkins-hbase4:45571] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:49,859 INFO [RS:0;jenkins-hbase4:45571] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:49,948 DEBUG [jenkins-hbase4:38421] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 18:01:49,948 DEBUG [jenkins-hbase4:38421] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:49,949 DEBUG [jenkins-hbase4:38421] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:49,949 DEBUG [jenkins-hbase4:38421] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:49,949 DEBUG [jenkins-hbase4:38421] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:49,949 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38241,1676656909558, state=OPENING 2023-02-17 18:01:49,951 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 18:01:49,952 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:49,952 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:49,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38241,1676656909558}] 2023-02-17 18:01:50,108 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:50,109 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:50,110 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36532, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:50,113 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 18:01:50,113 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:50,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38241%2C1676656909558.meta, suffix=.meta, logDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/WALs/jenkins-hbase4.apache.org,38241,1676656909558, archiveDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/oldWALs, maxLogs=32 2023-02-17 18:01:50,128 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37963,DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e,DISK] 2023-02-17 18:01:50,128 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46063,DS-7773b02f-012a-492d-8577-ee10f69bc112,DISK] 2023-02-17 18:01:50,129 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/WALs/jenkins-hbase4.apache.org,38241,1676656909558/jenkins-hbase4.apache.org%2C38241%2C1676656909558.meta.1676656910115.meta 2023-02-17 18:01:50,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37963,DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e,DISK], DatanodeInfoWithStorage[127.0.0.1:46063,DS-7773b02f-012a-492d-8577-ee10f69bc112,DISK]] 2023-02-17 18:01:50,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:50,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 18:01:50,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 18:01:50,130 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 18:01:50,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 18:01:50,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:50,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 18:01:50,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 18:01:50,131 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:50,132 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/info 2023-02-17 18:01:50,132 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/info 2023-02-17 18:01:50,132 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:50,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:50,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:50,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:50,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:50,134 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:50,134 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:50,134 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:50,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/table 2023-02-17 18:01:50,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/table 2023-02-17 18:01:50,135 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:50,135 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:50,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740 2023-02-17 18:01:50,137 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740 2023-02-17 18:01:50,138 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:50,139 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:50,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61620710, jitterRate=-0.08177986741065979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:50,139 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:50,140 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676656910108 2023-02-17 18:01:50,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 18:01:50,143 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 18:01:50,144 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38241,1676656909558, state=OPEN 2023-02-17 18:01:50,146 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 18:01:50,146 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:50,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 18:01:50,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38241,1676656909558 in 194 msec 2023-02-17 18:01:50,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 18:01:50,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-17 18:01:50,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 388 msec 2023-02-17 18:01:50,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676656910149, completionTime=-1 2023-02-17 18:01:50,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 18:01:50,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 18:01:50,151 DEBUG [hconnection-0x593c72fe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:50,152 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36544, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:50,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 18:01:50,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676656970154 2023-02-17 18:01:50,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676657030154 2023-02-17 18:01:50,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-17 18:01:50,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38421,1676656909466-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:50,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38421,1676656909466-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:50,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38421,1676656909466-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:50,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38421, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:50,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:50,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 18:01:50,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:50,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 18:01:50,160 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 18:01:50,162 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:50,162 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:50,163 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:50,164 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c empty. 2023-02-17 18:01:50,164 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:50,164 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 18:01:50,171 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:50,172 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => cb3d1123c501d85b31fff79977a9ad7c, NAME => 'hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp 2023-02-17 18:01:50,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:50,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing cb3d1123c501d85b31fff79977a9ad7c, disabling compactions & flushes 2023-02-17 18:01:50,177 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:50,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:50,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. after waiting 0 ms 2023-02-17 18:01:50,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:50,177 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:50,177 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for cb3d1123c501d85b31fff79977a9ad7c: 2023-02-17 18:01:50,179 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:50,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656910180"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656910180"}]},"ts":"1676656910180"} 2023-02-17 18:01:50,182 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:50,183 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:50,183 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656910183"}]},"ts":"1676656910183"} 2023-02-17 18:01:50,184 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 18:01:50,192 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:50,192 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:50,192 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:50,193 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:50,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cb3d1123c501d85b31fff79977a9ad7c, ASSIGN}] 2023-02-17 18:01:50,195 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cb3d1123c501d85b31fff79977a9ad7c, ASSIGN 2023-02-17 18:01:50,195 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cb3d1123c501d85b31fff79977a9ad7c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45571,1676656909514; forceNewPlan=false, retain=false 2023-02-17 18:01:50,345 INFO [jenkins-hbase4:38421] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:50,346 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cb3d1123c501d85b31fff79977a9ad7c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:50,346 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656910346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656910346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656910346"}]},"ts":"1676656910346"} 2023-02-17 18:01:50,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cb3d1123c501d85b31fff79977a9ad7c, server=jenkins-hbase4.apache.org,45571,1676656909514}] 2023-02-17 18:01:50,500 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:50,500 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:50,502 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45658, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:50,505 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:50,506 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45571%2C1676656909514, suffix=, logDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/WALs/jenkins-hbase4.apache.org,45571,1676656909514, archiveDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/oldWALs, maxLogs=32 2023-02-17 18:01:50,525 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37963,DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e,DISK] 2023-02-17 18:01:50,525 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46063,DS-7773b02f-012a-492d-8577-ee10f69bc112,DISK] 2023-02-17 18:01:50,527 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/WALs/jenkins-hbase4.apache.org,45571,1676656909514/jenkins-hbase4.apache.org%2C45571%2C1676656909514.1676656910507 2023-02-17 18:01:50,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37963,DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e,DISK], DatanodeInfoWithStorage[127.0.0.1:46063,DS-7773b02f-012a-492d-8577-ee10f69bc112,DISK]] 2023-02-17 18:01:50,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb3d1123c501d85b31fff79977a9ad7c, NAME => 'hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:50,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:50,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:50,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:50,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:50,528 INFO [StoreOpener-cb3d1123c501d85b31fff79977a9ad7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:50,530 DEBUG [StoreOpener-cb3d1123c501d85b31fff79977a9ad7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c/info 2023-02-17 18:01:50,530 DEBUG [StoreOpener-cb3d1123c501d85b31fff79977a9ad7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c/info 2023-02-17 18:01:50,530 INFO [StoreOpener-cb3d1123c501d85b31fff79977a9ad7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb3d1123c501d85b31fff79977a9ad7c columnFamilyName info 2023-02-17 18:01:50,531 INFO [StoreOpener-cb3d1123c501d85b31fff79977a9ad7c-1] regionserver.HStore(310): Store=cb3d1123c501d85b31fff79977a9ad7c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:50,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:50,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:50,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:50,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:50,536 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cb3d1123c501d85b31fff79977a9ad7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68863518, jitterRate=0.026146382093429565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:50,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cb3d1123c501d85b31fff79977a9ad7c: 2023-02-17 18:01:50,541 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c., pid=6, masterSystemTime=1676656910500 2023-02-17 18:01:50,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:50,545 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:50,545 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cb3d1123c501d85b31fff79977a9ad7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:50,545 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656910545"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656910545"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656910545"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656910545"}]},"ts":"1676656910545"} 2023-02-17 18:01:50,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 18:01:50,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cb3d1123c501d85b31fff79977a9ad7c, server=jenkins-hbase4.apache.org,45571,1676656909514 in 199 msec 2023-02-17 18:01:50,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 18:01:50,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cb3d1123c501d85b31fff79977a9ad7c, ASSIGN in 355 msec 2023-02-17 18:01:50,549 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:50,549 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656910549"}]},"ts":"1676656910549"} 2023-02-17 18:01:50,550 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 18:01:50,552 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:50,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 393 msec 2023-02-17 18:01:50,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 18:01:50,562 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:50,562 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:50,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:50,565 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45672, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:50,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 18:01:50,573 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:50,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-17 18:01:50,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 18:01:50,583 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:50,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 6 msec 2023-02-17 18:01:50,592 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 18:01:50,594 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 18:01:50,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.002sec 2023-02-17 18:01:50,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 18:01:50,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 18:01:50,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 18:01:50,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38421,1676656909466-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 18:01:50,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38421,1676656909466-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 18:01:50,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 18:01:50,682 DEBUG [Listener at localhost/41669] zookeeper.ReadOnlyZKClient(139): Connect 0x1f21ceec to 127.0.0.1:58230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:50,691 DEBUG [Listener at localhost/41669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6435ecb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:50,692 DEBUG [hconnection-0x771bc91c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:50,694 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36556, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:50,695 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:50,695 DEBUG [Listener at localhost/41669] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 18:01:50,698 DEBUG [Listener at localhost/41669] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 18:01:50,700 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44684, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 18:01:50,700 INFO [Listener at localhost/41669] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-17 18:01:50,701 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-17 18:01:50,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 18:01:50,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:44684 deadline: 1676656970700, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-17 18:01:50,701 INFO [Listener at localhost/41669] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-17 18:01:50,703 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:50,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:50,705 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:50,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-17 18:01:50,706 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:50,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:50,707 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:50,707 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a empty. 2023-02-17 18:01:50,707 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:50,707 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-17 18:01:50,715 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:50,716 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2203d1e40bb76565aff6af2cc5cab30a, NAME => 'testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp 2023-02-17 18:01:50,721 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:50,721 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 2203d1e40bb76565aff6af2cc5cab30a, disabling compactions & flushes 2023-02-17 18:01:50,722 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:50,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:50,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. after waiting 0 ms 2023-02-17 18:01:50,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:50,722 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:50,722 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 2203d1e40bb76565aff6af2cc5cab30a: 2023-02-17 18:01:50,723 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:50,724 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676656910724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656910724"}]},"ts":"1676656910724"} 2023-02-17 18:01:50,725 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:50,726 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:50,726 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656910726"}]},"ts":"1676656910726"} 2023-02-17 18:01:50,727 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-17 18:01:50,731 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:50,732 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:50,732 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:50,732 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:50,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2203d1e40bb76565aff6af2cc5cab30a, ASSIGN}] 2023-02-17 18:01:50,734 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2203d1e40bb76565aff6af2cc5cab30a, ASSIGN 2023-02-17 18:01:50,735 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2203d1e40bb76565aff6af2cc5cab30a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38241,1676656909558; forceNewPlan=false, retain=false 2023-02-17 18:01:50,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:50,860 INFO [RS:1;jenkins-hbase4:38241] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38241%2C1676656909558, suffix=, logDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/WALs/jenkins-hbase4.apache.org,38241,1676656909558, archiveDir=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/oldWALs, maxLogs=32 2023-02-17 18:01:50,872 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37963,DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e,DISK] 2023-02-17 18:01:50,872 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46063,DS-7773b02f-012a-492d-8577-ee10f69bc112,DISK] 2023-02-17 18:01:50,874 INFO [RS:1;jenkins-hbase4:38241] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/WALs/jenkins-hbase4.apache.org,38241,1676656909558/jenkins-hbase4.apache.org%2C38241%2C1676656909558.1676656910860 2023-02-17 18:01:50,874 DEBUG [RS:1;jenkins-hbase4:38241] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37963,DS-7ece77b8-4aac-444c-8e83-1719fe3dba9e,DISK], DatanodeInfoWithStorage[127.0.0.1:46063,DS-7773b02f-012a-492d-8577-ee10f69bc112,DISK]] 2023-02-17 18:01:50,885 INFO [jenkins-hbase4:38421] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:50,885 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2203d1e40bb76565aff6af2cc5cab30a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:50,885 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676656910885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656910885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656910885"}]},"ts":"1676656910885"} 2023-02-17 18:01:50,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 2203d1e40bb76565aff6af2cc5cab30a, server=jenkins-hbase4.apache.org,38241,1676656909558}] 2023-02-17 18:01:51,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:51,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:51,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2203d1e40bb76565aff6af2cc5cab30a, NAME => 'testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:51,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:51,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:51,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:51,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:51,043 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:51,044 DEBUG [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1 2023-02-17 18:01:51,044 DEBUG [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1 2023-02-17 18:01:51,044 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2203d1e40bb76565aff6af2cc5cab30a columnFamilyName f1 2023-02-17 18:01:51,045 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(310): Store=2203d1e40bb76565aff6af2cc5cab30a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:51,045 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:51,046 DEBUG [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2 2023-02-17 18:01:51,046 DEBUG [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2 2023-02-17 18:01:51,046 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2203d1e40bb76565aff6af2cc5cab30a columnFamilyName f2 2023-02-17 18:01:51,047 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(310): Store=2203d1e40bb76565aff6af2cc5cab30a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:51,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:51,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:51,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:51,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:51,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:51,051 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2203d1e40bb76565aff6af2cc5cab30a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66741626, jitterRate=-0.005472272634506226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:51,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2203d1e40bb76565aff6af2cc5cab30a: 2023-02-17 18:01:51,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a., pid=12, masterSystemTime=1676656911038 2023-02-17 18:01:51,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:51,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:51,054 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2203d1e40bb76565aff6af2cc5cab30a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,054 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676656911054"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656911054"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656911054"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656911054"}]},"ts":"1676656911054"} 2023-02-17 18:01:51,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 18:01:51,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 2203d1e40bb76565aff6af2cc5cab30a, server=jenkins-hbase4.apache.org,38241,1676656909558 in 168 msec 2023-02-17 18:01:51,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 18:01:51,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2203d1e40bb76565aff6af2cc5cab30a, ASSIGN in 326 msec 2023-02-17 18:01:51,062 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:51,062 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656911062"}]},"ts":"1676656911062"} 2023-02-17 18:01:51,064 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-17 18:01:51,066 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:51,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 363 msec 2023-02-17 18:01:51,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:51,310 INFO [Listener at localhost/41669] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-17 18:01:51,311 DEBUG [Listener at localhost/41669] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-17 18:01:51,311 INFO [Listener at localhost/41669] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:51,314 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-17 18:01:51,315 INFO [Listener at localhost/41669] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:51,315 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-17 18:01:51,315 INFO [Listener at localhost/41669] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 18:01:51,346 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38241] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:51,445 INFO [Listener at localhost/41669] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 18:01:51,445 INFO [Listener at localhost/41669] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 18:01:51,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-17 18:01:51,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676656911447 (current time:1676656911447). 2023-02-17 18:01:51,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 18:01:51,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] zookeeper.ReadOnlyZKClient(139): Connect 0x3e7d7835 to 127.0.0.1:58230 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:51,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21e46eeb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:51,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:51,452 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:51,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e7d7835 to 127.0.0.1:58230 2023-02-17 18:01:51,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:51,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 18:01:51,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-17 18:01:51,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-17 18:01:51,456 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-17 18:01:51,457 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676657511457 2023-02-17 18:01:51,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-17 18:01:51,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,458 DEBUG [Listener at localhost/41669] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:51,458 DEBUG [Listener at localhost/41669] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 18:01:51,459 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-17 18:01:51,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-17 18:01:51,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-17 18:01:51,460 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-17 18:01:51,461 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676657511461 2023-02-17 18:01:51,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,468 INFO [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-17 18:01:51,468 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:51,469 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-17 18:01:51,469 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-17 18:01:51,469 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,469 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,470 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:51,470 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:51,470 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:51,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:51,470 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,470 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-17 18:01:51,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,472 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-17 18:01:51,472 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:51,472 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-17 18:01:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 18:01:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 18:01:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 18:01:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 18:01:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45571,1676656909514' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 18:01:51,473 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38241,1676656909558' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 18:01:51,475 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,475 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,475 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,475 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:51,475 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:51,476 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,476 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:51,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38241,1676656909558' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-17 18:01:51,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@502a7fb7[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:51,477 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-17 18:01:51,477 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,479 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,479 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,479 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,479 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 18:01:51,479 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:51,479 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 18:01:51,480 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 18:01:51,480 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45571,1676656909514' in zk 2023-02-17 18:01:51,480 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 18:01:51,480 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:01:51,480 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:51,480 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. started... 2023-02-17 18:01:51,480 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2203d1e40bb76565aff6af2cc5cab30a 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 18:01:51,481 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 18:01:51,481 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:51,481 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 18:01:51,498 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/.tmp/f1/e5260ce2af1f47429d8cf9de6f7bed2e 2023-02-17 18:01:51,519 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/.tmp/f2/54a7ed2beadd4251b5a372b28160f22f 2023-02-17 18:01:51,523 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/.tmp/f1/e5260ce2af1f47429d8cf9de6f7bed2e as hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/e5260ce2af1f47429d8cf9de6f7bed2e 2023-02-17 18:01:51,526 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/e5260ce2af1f47429d8cf9de6f7bed2e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 18:01:51,527 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/.tmp/f2/54a7ed2beadd4251b5a372b28160f22f as hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/54a7ed2beadd4251b5a372b28160f22f 2023-02-17 18:01:51,530 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/54a7ed2beadd4251b5a372b28160f22f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 18:01:51,531 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 2203d1e40bb76565aff6af2cc5cab30a in 51ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:51,531 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-17 18:01:51,531 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2203d1e40bb76565aff6af2cc5cab30a: 2023-02-17 18:01:51,531 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,532 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:51,532 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/e5260ce2af1f47429d8cf9de6f7bed2e] hfiles 2023-02-17 18:01:51,532 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/e5260ce2af1f47429d8cf9de6f7bed2e for snapshot=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,532 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/54a7ed2beadd4251b5a372b28160f22f] hfiles 2023-02-17 18:01:51,532 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/54a7ed2beadd4251b5a372b28160f22f for snapshot=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,537 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. completed. 2023-02-17 18:01:51,537 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:51,537 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 18:01:51,537 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 18:01:51,537 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,537 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 18:01:51,537 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38241,1676656909558' in zk 2023-02-17 18:01:51,539 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 18:01:51,539 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,539 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:51,539 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:51,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38241,1676656909558': 2023-02-17 18:01:51,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38241,1676656909558' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-17 18:01:51,541 INFO [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-17 18:01:51,542 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:51,542 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:51,542 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,542 INFO [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 18:01:51,543 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,543 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:51,543 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:51,543 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,544 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:51,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:51,544 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:51,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,544 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:51,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,545 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:51,546 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:51,551 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:51,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:51,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:51,551 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,551 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,552 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,552 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:51,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:51,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,552 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:51,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:51,559 DEBUG [Listener at localhost/41669] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:51,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-17 18:01:51,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:51,561 DEBUG [Listener at localhost/41669] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 18:01:51,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,579 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-17 18:01:51,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,580 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676656911457Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676656911551 (+94 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676656911551Writing data manifest for testWithMockedMapReduceSingleRegion at 1676656911554 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676656911561 (+7 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676656911579 (+18 ms) 2023-02-17 18:01:51,582 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-17 18:01:51,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 124 msec 2023-02-17 18:01:51,761 DEBUG [Listener at localhost/41669] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:51,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-17 18:01:51,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 18:01:51,762 INFO [Listener at localhost/41669] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 18:01:51,765 INFO [Listener at localhost/41669] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 18:01:51,771 INFO [Listener at localhost/41669] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 18:01:51,807 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38241] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:51,899 INFO [Listener at localhost/41669] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 18:01:51,905 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 18:01:51,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,908 INFO [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-17 18:01:51,908 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:51,909 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-17 18:01:51,909 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-17 18:01:51,910 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,910 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,911 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:51,911 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:51,911 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:51,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:51,911 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,911 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:51,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,912 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-17 18:01:51,913 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:51,914 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 18:01:51,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,916 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 18:01:51,916 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:01:51,916 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:51,916 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-17 18:01:51,916 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:51,916 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. started... 2023-02-17 18:01:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 18:01:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 18:01:51,917 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45571,1676656909514' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 18:01:51,917 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2203d1e40bb76565aff6af2cc5cab30a 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 18:01:51,919 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,919 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,919 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:51,934 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/.tmp/f1/7e0571211b0f42c1b841f14bd4a01fc8 2023-02-17 18:01:51,954 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/.tmp/f2/5d16f73e1df54e14bf50b92faef14355 2023-02-17 18:01:51,959 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/.tmp/f1/7e0571211b0f42c1b841f14bd4a01fc8 as hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/7e0571211b0f42c1b841f14bd4a01fc8 2023-02-17 18:01:51,962 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/7e0571211b0f42c1b841f14bd4a01fc8, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 18:01:51,963 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/.tmp/f2/5d16f73e1df54e14bf50b92faef14355 as hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/5d16f73e1df54e14bf50b92faef14355 2023-02-17 18:01:51,967 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/5d16f73e1df54e14bf50b92faef14355, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 18:01:51,967 INFO [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 2203d1e40bb76565aff6af2cc5cab30a in 50ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:51,968 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2203d1e40bb76565aff6af2cc5cab30a: 2023-02-17 18:01:51,968 DEBUG [rs(jenkins-hbase4.apache.org,38241,1676656909558)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:51,969 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 18:01:51,969 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 18:01:51,969 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,969 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-17 18:01:51,969 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38241,1676656909558' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-17 18:01:51,971 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,971 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:51,972 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,972 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:51,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38241,1676656909558' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-17 18:01:51,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5415e16a[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:51,974 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-17 18:01:51,974 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,975 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,975 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 18:01:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 18:01:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,976 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 18:01:51,976 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-17 18:01:51,976 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45571,1676656909514' in zk 2023-02-17 18:01:51,975 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38241,1676656909558' in zk 2023-02-17 18:01:51,976 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,976 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:51,977 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 18:01:51,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,38241,1676656909558' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 18:01:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-17 18:01:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,45571,1676656909514' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-17 18:01:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38241,1676656909558': 2023-02-17 18:01:51,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38241,1676656909558' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-17 18:01:51,981 INFO [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-17 18:01:51,981 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:51,981 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:51,981 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,981 INFO [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 18:01:51,986 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,986 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,986 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,986 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:51,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,986 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:51,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:51,986 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:51,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:51,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:51,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,987 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:51,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,989 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:51,989 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,993 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:51,993 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:51,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:51,993 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:51,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:51,993 DEBUG [(jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:51,993 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:51,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-17 18:01:51,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 18:01:51,993 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,993 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:51,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:51,993 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,993 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,993 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:51,994 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,994 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:51,994 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,994 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:51,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:51,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:51,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:51,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:51,994 DEBUG [Listener at localhost/41669] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:51,994 DEBUG [Listener at localhost/41669] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 18:01:52,094 DEBUG [Listener at localhost/41669] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 18:01:52,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 18:01:52,100 INFO [Listener at localhost/41669] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676656911447 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:52,100 DEBUG [Listener at localhost/41669] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36489/user/jenkins/test-data/a1945e32-b854-0803-37a3-e0f37f9d2ddd/testWithMockedMapReduceSingleRegion/823cd1ed-9856-43d1-862c-41d1c4f0b5cc/data/default/testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,100 INFO [Listener at localhost/41669] snapshot.RestoreSnapshotHelper(239): region to add: 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:52,100 INFO [Listener at localhost/41669] snapshot.RestoreSnapshotHelper(585): clone region=2203d1e40bb76565aff6af2cc5cab30a as 2203d1e40bb76565aff6af2cc5cab30a in snapshot testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,101 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2203d1e40bb76565aff6af2cc5cab30a, NAME => 'testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36489/user/jenkins/test-data/a1945e32-b854-0803-37a3-e0f37f9d2ddd/testWithMockedMapReduceSingleRegion/823cd1ed-9856-43d1-862c-41d1c4f0b5cc 2023-02-17 18:01:52,107 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:52,107 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e5260ce2af1f47429d8cf9de6f7bed2e from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,109 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 54a7ed2beadd4251b5a372b28160f22f from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,111 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2203d1e40bb76565aff6af2cc5cab30a, disabling compactions & flushes 2023-02-17 18:01:52,111 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,111 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,111 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. after waiting 0 ms 2023-02-17 18:01:52,111 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,111 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,111 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2203d1e40bb76565aff6af2cc5cab30a: 2023-02-17 18:01:52,111 INFO [Listener at localhost/41669] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676656911447 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:52,111 DEBUG [Listener at localhost/41669] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36489/user/jenkins/test-data/a1945e32-b854-0803-37a3-e0f37f9d2ddd/testWithMockedMapReduceSingleRegion/823cd1ed-9856-43d1-862c-41d1c4f0b5cc 2023-02-17 18:01:52,111 DEBUG [Listener at localhost/41669] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36489/user/jenkins/test-data/a1945e32-b854-0803-37a3-e0f37f9d2ddd/testWithMockedMapReduceSingleRegion/823cd1ed-9856-43d1-862c-41d1c4f0b5cc 2023-02-17 18:01:52,112 DEBUG [Listener at localhost/41669] util.CommonFSUtils(699): |-data/ 2023-02-17 18:01:52,112 DEBUG [Listener at localhost/41669] util.CommonFSUtils(699): |----default/ 2023-02-17 18:01:52,112 DEBUG [Listener at localhost/41669] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-17 18:01:52,113 DEBUG [Listener at localhost/41669] util.CommonFSUtils(699): |----------2203d1e40bb76565aff6af2cc5cab30a/ 2023-02-17 18:01:52,113 DEBUG [Listener at localhost/41669] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:52,113 DEBUG [Listener at localhost/41669] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:52,113 DEBUG [Listener at localhost/41669] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=2203d1e40bb76565aff6af2cc5cab30a-e5260ce2af1f47429d8cf9de6f7bed2e 2023-02-17 18:01:52,114 DEBUG [Listener at localhost/41669] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:52,114 DEBUG [Listener at localhost/41669] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=2203d1e40bb76565aff6af2cc5cab30a-54a7ed2beadd4251b5a372b28160f22f 2023-02-17 18:01:52,117 INFO [Listener at localhost/41669] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 18:01:52,121 DEBUG [Listener at localhost/41669] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:52,121 INFO [Listener at localhost/41669] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:01:52,121 DEBUG [Listener at localhost/41669] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:52,123 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:52,124 DEBUG [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/a1945e32-b854-0803-37a3-e0f37f9d2ddd/testWithMockedMapReduceSingleRegion/823cd1ed-9856-43d1-862c-41d1c4f0b5cc/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1 2023-02-17 18:01:52,124 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2203d1e40bb76565aff6af2cc5cab30a columnFamilyName f1 2023-02-17 18:01:52,128 DEBUG [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(539): loaded hdfs://localhost:36489/user/jenkins/test-data/a1945e32-b854-0803-37a3-e0f37f9d2ddd/testWithMockedMapReduceSingleRegion/823cd1ed-9856-43d1-862c-41d1c4f0b5cc/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/testWithMockedMapReduceSingleRegion=2203d1e40bb76565aff6af2cc5cab30a-e5260ce2af1f47429d8cf9de6f7bed2e 2023-02-17 18:01:52,128 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(310): Store=2203d1e40bb76565aff6af2cc5cab30a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:52,128 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:52,128 DEBUG [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36489/user/jenkins/test-data/a1945e32-b854-0803-37a3-e0f37f9d2ddd/testWithMockedMapReduceSingleRegion/823cd1ed-9856-43d1-862c-41d1c4f0b5cc/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2 2023-02-17 18:01:52,129 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2203d1e40bb76565aff6af2cc5cab30a columnFamilyName f2 2023-02-17 18:01:52,132 DEBUG [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(539): loaded hdfs://localhost:36489/user/jenkins/test-data/a1945e32-b854-0803-37a3-e0f37f9d2ddd/testWithMockedMapReduceSingleRegion/823cd1ed-9856-43d1-862c-41d1c4f0b5cc/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/testWithMockedMapReduceSingleRegion=2203d1e40bb76565aff6af2cc5cab30a-54a7ed2beadd4251b5a372b28160f22f 2023-02-17 18:01:52,132 INFO [StoreOpener-2203d1e40bb76565aff6af2cc5cab30a-1] regionserver.HStore(310): Store=2203d1e40bb76565aff6af2cc5cab30a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:52,133 DEBUG [Listener at localhost/41669] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:52,133 INFO [Listener at localhost/41669] regionserver.HRegion(1071): Opened 2203d1e40bb76565aff6af2cc5cab30a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62976945, jitterRate=-0.061570391058921814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:52,133 DEBUG [Listener at localhost/41669] regionserver.HRegion(964): Region open journal for 2203d1e40bb76565aff6af2cc5cab30a: 2023-02-17 18:01:52,181 DEBUG [Listener at localhost/41669] regionserver.HRegion(1603): Closing 2203d1e40bb76565aff6af2cc5cab30a, disabling compactions & flushes 2023-02-17 18:01:52,181 INFO [Listener at localhost/41669] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,181 DEBUG [Listener at localhost/41669] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,181 DEBUG [Listener at localhost/41669] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. after waiting 0 ms 2023-02-17 18:01:52,181 DEBUG [Listener at localhost/41669] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,182 INFO [Listener at localhost/41669] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,182 DEBUG [Listener at localhost/41669] regionserver.HRegion(1557): Region close journal for 2203d1e40bb76565aff6af2cc5cab30a: 2023-02-17 18:01:52,186 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-17 18:01:52,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,190 INFO [Listener at localhost/41669] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:01:52,194 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656912194"}]},"ts":"1676656912194"} 2023-02-17 18:01:52,195 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-17 18:01:52,196 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-17 18:01:52,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2203d1e40bb76565aff6af2cc5cab30a, UNASSIGN}] 2023-02-17 18:01:52,199 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2203d1e40bb76565aff6af2cc5cab30a, UNASSIGN 2023-02-17 18:01:52,199 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2203d1e40bb76565aff6af2cc5cab30a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:52,199 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676656912199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656912199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656912199"}]},"ts":"1676656912199"} 2023-02-17 18:01:52,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 2203d1e40bb76565aff6af2cc5cab30a, server=jenkins-hbase4.apache.org,38241,1676656909558}] 2023-02-17 18:01:52,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:01:52,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:52,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2203d1e40bb76565aff6af2cc5cab30a, disabling compactions & flushes 2023-02-17 18:01:52,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. after waiting 0 ms 2023-02-17 18:01:52,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:52,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a. 2023-02-17 18:01:52,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2203d1e40bb76565aff6af2cc5cab30a: 2023-02-17 18:01:52,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:52,359 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2203d1e40bb76565aff6af2cc5cab30a, regionState=CLOSED 2023-02-17 18:01:52,360 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676656912359"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656912359"}]},"ts":"1676656912359"} 2023-02-17 18:01:52,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 18:01:52,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 2203d1e40bb76565aff6af2cc5cab30a, server=jenkins-hbase4.apache.org,38241,1676656909558 in 161 msec 2023-02-17 18:01:52,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 18:01:52,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=2203d1e40bb76565aff6af2cc5cab30a, UNASSIGN in 165 msec 2023-02-17 18:01:52,365 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656912365"}]},"ts":"1676656912365"} 2023-02-17 18:01:52,366 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-17 18:01:52,368 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-17 18:01:52,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 178 msec 2023-02-17 18:01:52,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:01:52,497 INFO [Listener at localhost/41669] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-17 18:01:52,498 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,500 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,501 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 18:01:52,504 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:52,505 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1, FileablePath, hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2, FileablePath, hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/recovered.edits] 2023-02-17 18:01:52,508 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/7e0571211b0f42c1b841f14bd4a01fc8 to hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/archive/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/7e0571211b0f42c1b841f14bd4a01fc8 2023-02-17 18:01:52,509 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/e5260ce2af1f47429d8cf9de6f7bed2e to hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/archive/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f1/e5260ce2af1f47429d8cf9de6f7bed2e 2023-02-17 18:01:52,512 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/54a7ed2beadd4251b5a372b28160f22f to hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/archive/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/54a7ed2beadd4251b5a372b28160f22f 2023-02-17 18:01:52,513 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/5d16f73e1df54e14bf50b92faef14355 to hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/archive/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/f2/5d16f73e1df54e14bf50b92faef14355 2023-02-17 18:01:52,515 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/recovered.edits/12.seqid to hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/archive/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a/recovered.edits/12.seqid 2023-02-17 18:01:52,516 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/.tmp/data/default/testWithMockedMapReduceSingleRegion/2203d1e40bb76565aff6af2cc5cab30a 2023-02-17 18:01:52,516 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-17 18:01:52,518 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,519 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-17 18:01:52,521 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-17 18:01:52,521 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,521 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-17 18:01:52,522 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656912521"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:52,523 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 18:01:52,523 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2203d1e40bb76565aff6af2cc5cab30a, NAME => 'testWithMockedMapReduceSingleRegion,,1676656910703.2203d1e40bb76565aff6af2cc5cab30a.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 18:01:52,523 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-17 18:01:52,523 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676656912523"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:52,524 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-17 18:01:52,527 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-17 18:01:52,528 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 29 msec 2023-02-17 18:01:52,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38421] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 18:01:52,603 INFO [Listener at localhost/41669] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-17 18:01:52,603 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 18:01:52,603 INFO [Listener at localhost/41669] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 18:01:52,604 DEBUG [Listener at localhost/41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f21ceec to 127.0.0.1:58230 2023-02-17 18:01:52,604 DEBUG [Listener at localhost/41669] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:52,604 DEBUG [Listener at localhost/41669] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 18:01:52,604 DEBUG [Listener at localhost/41669] util.JVMClusterUtil(257): Found active master hash=1133295074, stopped=false 2023-02-17 18:01:52,604 INFO [Listener at localhost/41669] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:52,606 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:52,606 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:52,606 INFO [Listener at localhost/41669] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 18:01:52,606 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:52,606 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:52,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:52,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:52,608 DEBUG [Listener at localhost/41669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43440909 to 127.0.0.1:58230 2023-02-17 18:01:52,608 DEBUG [Listener at localhost/41669] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:52,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:52,608 INFO [Listener at localhost/41669] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45571,1676656909514' ***** 2023-02-17 18:01:52,609 INFO [Listener at localhost/41669] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:52,609 INFO [Listener at localhost/41669] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38241,1676656909558' ***** 2023-02-17 18:01:52,609 INFO [Listener at localhost/41669] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:52,609 INFO [RS:0;jenkins-hbase4:45571] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:52,609 INFO [RS:1;jenkins-hbase4:38241] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:52,609 INFO [RS:0;jenkins-hbase4:45571] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:52,609 INFO [RS:1;jenkins-hbase4:38241] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:52,609 INFO [RS:1;jenkins-hbase4:38241] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:52,609 INFO [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:52,609 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:52,609 DEBUG [RS:1;jenkins-hbase4:38241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6170a5a8 to 127.0.0.1:58230 2023-02-17 18:01:52,609 INFO [RS:0;jenkins-hbase4:45571] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:52,609 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:52,611 INFO [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(3304): Received CLOSE for cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:52,610 DEBUG [RS:1;jenkins-hbase4:38241] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:52,612 INFO [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:52,612 INFO [RS:1;jenkins-hbase4:38241] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:52,612 INFO [RS:1;jenkins-hbase4:38241] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:52,612 INFO [RS:1;jenkins-hbase4:38241] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:52,612 INFO [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 18:01:52,612 INFO [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 18:01:52,612 DEBUG [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-17 18:01:52,612 DEBUG [RS:0;jenkins-hbase4:45571] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39ed23c9 to 127.0.0.1:58230 2023-02-17 18:01:52,650 DEBUG [RS:0;jenkins-hbase4:45571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:52,650 INFO [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 18:01:52,650 DEBUG [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1479): Online Regions={cb3d1123c501d85b31fff79977a9ad7c=hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c.} 2023-02-17 18:01:52,650 DEBUG [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1505): Waiting on cb3d1123c501d85b31fff79977a9ad7c 2023-02-17 18:01:52,650 DEBUG [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 18:01:52,650 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:52,650 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:52,650 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:52,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cb3d1123c501d85b31fff79977a9ad7c, disabling compactions & flushes 2023-02-17 18:01:52,654 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:52,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:52,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:52,655 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:52,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. after waiting 0 ms 2023-02-17 18:01:52,655 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:52,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:52,655 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:52,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing cb3d1123c501d85b31fff79977a9ad7c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 18:01:52,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-17 18:01:52,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c/.tmp/info/622be9b41ef248c5ae73cd8a1a4e2f84 2023-02-17 18:01:52,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/.tmp/info/741d8b87833448948fe76dc8919a47ba 2023-02-17 18:01:52,670 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 741d8b87833448948fe76dc8919a47ba 2023-02-17 18:01:52,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c/.tmp/info/622be9b41ef248c5ae73cd8a1a4e2f84 as hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c/info/622be9b41ef248c5ae73cd8a1a4e2f84 2023-02-17 18:01:52,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c/info/622be9b41ef248c5ae73cd8a1a4e2f84, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 18:01:52,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cb3d1123c501d85b31fff79977a9ad7c in 21ms, sequenceid=6, compaction requested=false 2023-02-17 18:01:52,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/namespace/cb3d1123c501d85b31fff79977a9ad7c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 18:01:52,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:52,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cb3d1123c501d85b31fff79977a9ad7c: 2023-02-17 18:01:52,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676656910159.cb3d1123c501d85b31fff79977a9ad7c. 2023-02-17 18:01:52,687 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/.tmp/rep_barrier/d224fcd26f074120a912204c92785bdb 2023-02-17 18:01:52,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d224fcd26f074120a912204c92785bdb 2023-02-17 18:01:52,697 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/.tmp/table/54e2e4897c10415b9a8e170970debafc 2023-02-17 18:01:52,700 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54e2e4897c10415b9a8e170970debafc 2023-02-17 18:01:52,700 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/.tmp/info/741d8b87833448948fe76dc8919a47ba as hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/info/741d8b87833448948fe76dc8919a47ba 2023-02-17 18:01:52,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 741d8b87833448948fe76dc8919a47ba 2023-02-17 18:01:52,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/info/741d8b87833448948fe76dc8919a47ba, entries=12, sequenceid=21, filesize=6.3 K 2023-02-17 18:01:52,705 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/.tmp/rep_barrier/d224fcd26f074120a912204c92785bdb as hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/rep_barrier/d224fcd26f074120a912204c92785bdb 2023-02-17 18:01:52,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d224fcd26f074120a912204c92785bdb 2023-02-17 18:01:52,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/rep_barrier/d224fcd26f074120a912204c92785bdb, entries=1, sequenceid=21, filesize=5.0 K 2023-02-17 18:01:52,710 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/.tmp/table/54e2e4897c10415b9a8e170970debafc as hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/table/54e2e4897c10415b9a8e170970debafc 2023-02-17 18:01:52,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 54e2e4897c10415b9a8e170970debafc 2023-02-17 18:01:52,714 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/table/54e2e4897c10415b9a8e170970debafc, entries=4, sequenceid=21, filesize=5.1 K 2023-02-17 18:01:52,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=21, compaction requested=false 2023-02-17 18:01:52,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 18:01:52,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 18:01:52,723 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:52,723 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:52,723 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:52,838 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-17 18:01:52,838 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-17 18:01:52,851 INFO [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45571,1676656909514; all regions closed. 2023-02-17 18:01:52,853 INFO [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38241,1676656909558; all regions closed. 2023-02-17 18:01:52,854 DEBUG [RS:0;jenkins-hbase4:45571] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/oldWALs 2023-02-17 18:01:52,856 INFO [RS:0;jenkins-hbase4:45571] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45571%2C1676656909514:(num 1676656910507) 2023-02-17 18:01:52,856 DEBUG [RS:0;jenkins-hbase4:45571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:52,856 INFO [RS:0;jenkins-hbase4:45571] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:52,856 INFO [RS:0;jenkins-hbase4:45571] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:52,856 INFO [RS:0;jenkins-hbase4:45571] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:52,856 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:52,856 INFO [RS:0;jenkins-hbase4:45571] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:52,856 INFO [RS:0;jenkins-hbase4:45571] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:52,857 INFO [RS:0;jenkins-hbase4:45571] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45571 2023-02-17 18:01:52,858 DEBUG [RS:1;jenkins-hbase4:38241] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/oldWALs 2023-02-17 18:01:52,859 INFO [RS:1;jenkins-hbase4:38241] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38241%2C1676656909558.meta:.meta(num 1676656910115) 2023-02-17 18:01:52,859 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:52,859 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:52,859 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45571,1676656909514 2023-02-17 18:01:52,859 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:52,859 ERROR [Listener at localhost/41669-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4df1551d rejected from java.util.concurrent.ThreadPoolExecutor@49ced87b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:52,859 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:52,859 ERROR [Listener at localhost/41669-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a141b5f rejected from java.util.concurrent.ThreadPoolExecutor@49ced87b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:52,860 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45571,1676656909514] 2023-02-17 18:01:52,860 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45571,1676656909514; numProcessing=1 2023-02-17 18:01:52,861 DEBUG [RS:1;jenkins-hbase4:38241] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/oldWALs 2023-02-17 18:01:52,862 INFO [RS:1;jenkins-hbase4:38241] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38241%2C1676656909558:(num 1676656910860) 2023-02-17 18:01:52,862 DEBUG [RS:1;jenkins-hbase4:38241] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:52,862 INFO [RS:1;jenkins-hbase4:38241] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:52,862 INFO [RS:1;jenkins-hbase4:38241] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:52,862 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:52,863 INFO [RS:1;jenkins-hbase4:38241] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38241 2023-02-17 18:01:52,863 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45571,1676656909514 already deleted, retry=false 2023-02-17 18:01:52,863 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45571,1676656909514 expired; onlineServers=1 2023-02-17 18:01:52,864 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38241,1676656909558 2023-02-17 18:01:52,864 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:52,864 ERROR [Listener at localhost/41669-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66e69293 rejected from java.util.concurrent.ThreadPoolExecutor@62d91a97[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:52,865 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38241,1676656909558] 2023-02-17 18:01:52,865 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38241,1676656909558; numProcessing=2 2023-02-17 18:01:52,866 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38241,1676656909558 already deleted, retry=false 2023-02-17 18:01:52,866 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38241,1676656909558 expired; onlineServers=0 2023-02-17 18:01:52,866 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38421,1676656909466' ***** 2023-02-17 18:01:52,867 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 18:01:52,867 DEBUG [M:0;jenkins-hbase4:38421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47b3394b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:52,867 INFO [M:0;jenkins-hbase4:38421] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38421,1676656909466 2023-02-17 18:01:52,867 INFO [M:0;jenkins-hbase4:38421] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38421,1676656909466; all regions closed. 2023-02-17 18:01:52,867 DEBUG [M:0;jenkins-hbase4:38421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:52,867 DEBUG [M:0;jenkins-hbase4:38421] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 18:01:52,868 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 18:01:52,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656909765] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656909765,5,FailOnTimeoutGroup] 2023-02-17 18:01:52,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656909765] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656909765,5,FailOnTimeoutGroup] 2023-02-17 18:01:52,868 DEBUG [M:0;jenkins-hbase4:38421] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 18:01:52,869 INFO [M:0;jenkins-hbase4:38421] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 18:01:52,869 INFO [M:0;jenkins-hbase4:38421] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 18:01:52,869 INFO [M:0;jenkins-hbase4:38421] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 18:01:52,869 DEBUG [M:0;jenkins-hbase4:38421] master.HMaster(1512): Stopping service threads 2023-02-17 18:01:52,869 INFO [M:0;jenkins-hbase4:38421] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 18:01:52,870 ERROR [M:0;jenkins-hbase4:38421] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 18:01:52,870 INFO [M:0;jenkins-hbase4:38421] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 18:01:52,870 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 18:01:52,870 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:52,870 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:52,870 DEBUG [M:0;jenkins-hbase4:38421] zookeeper.ZKUtil(398): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 18:01:52,870 WARN [M:0;jenkins-hbase4:38421] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 18:01:52,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:52,870 INFO [M:0;jenkins-hbase4:38421] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 18:01:52,871 INFO [M:0;jenkins-hbase4:38421] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 18:01:52,871 DEBUG [M:0;jenkins-hbase4:38421] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:52,871 INFO [M:0;jenkins-hbase4:38421] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:52,871 DEBUG [M:0;jenkins-hbase4:38421] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:52,871 DEBUG [M:0;jenkins-hbase4:38421] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:52,871 DEBUG [M:0;jenkins-hbase4:38421] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:52,871 INFO [M:0;jenkins-hbase4:38421] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.12 KB heapSize=67.06 KB 2023-02-17 18:01:52,879 INFO [M:0;jenkins-hbase4:38421] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.12 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/289c44d7a0384d1ca4990ee5670f97dc 2023-02-17 18:01:52,883 DEBUG [M:0;jenkins-hbase4:38421] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/289c44d7a0384d1ca4990ee5670f97dc as hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/289c44d7a0384d1ca4990ee5670f97dc 2023-02-17 18:01:52,887 INFO [M:0;jenkins-hbase4:38421] regionserver.HStore(1080): Added hdfs://localhost:36489/user/jenkins/test-data/b0634054-d2c7-4c4f-9050-191d5f592f4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/289c44d7a0384d1ca4990ee5670f97dc, entries=17, sequenceid=132, filesize=8.7 K 2023-02-17 18:01:52,888 INFO [M:0;jenkins-hbase4:38421] regionserver.HRegion(2947): Finished flush of dataSize ~56.12 KB/57463, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-17 18:01:52,888 INFO [M:0;jenkins-hbase4:38421] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:52,888 DEBUG [M:0;jenkins-hbase4:38421] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:52,890 INFO [M:0;jenkins-hbase4:38421] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 18:01:52,890 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:52,891 INFO [M:0;jenkins-hbase4:38421] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38421 2023-02-17 18:01:52,894 DEBUG [M:0;jenkins-hbase4:38421] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38421,1676656909466 already deleted, retry=false 2023-02-17 18:01:53,107 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:53,107 INFO [M:0;jenkins-hbase4:38421] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38421,1676656909466; zookeeper connection closed. 2023-02-17 18:01:53,107 ERROR [Listener at localhost/41669-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1cd07bf0 rejected from java.util.concurrent.ThreadPoolExecutor@18efecb2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:53,108 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): master:38421-0x1006372064f0000, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:53,108 ERROR [Listener at localhost/41669-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@736ad423 rejected from java.util.concurrent.ThreadPoolExecutor@18efecb2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:53,208 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:53,208 INFO [RS:1;jenkins-hbase4:38241] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38241,1676656909558; zookeeper connection closed. 2023-02-17 18:01:53,208 ERROR [Listener at localhost/41669-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44967bfd rejected from java.util.concurrent.ThreadPoolExecutor@62d91a97[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:53,208 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:38241-0x1006372064f0002, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:53,208 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@202e1fd8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@202e1fd8 2023-02-17 18:01:53,208 ERROR [Listener at localhost/41669-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c11a615 rejected from java.util.concurrent.ThreadPoolExecutor@62d91a97[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:53,308 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:53,308 INFO [RS:0;jenkins-hbase4:45571] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45571,1676656909514; zookeeper connection closed. 2023-02-17 18:01:53,308 ERROR [Listener at localhost/41669-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b8ea77 rejected from java.util.concurrent.ThreadPoolExecutor@49ced87b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:53,308 DEBUG [Listener at localhost/41669-EventThread] zookeeper.ZKWatcher(600): regionserver:45571-0x1006372064f0001, quorum=127.0.0.1:58230, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:53,308 ERROR [Listener at localhost/41669-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36f79049 rejected from java.util.concurrent.ThreadPoolExecutor@49ced87b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:53,308 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@59281dda] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@59281dda 2023-02-17 18:01:53,309 INFO [Listener at localhost/41669] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 18:01:53,309 WARN [Listener at localhost/41669] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:53,313 INFO [Listener at localhost/41669] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:53,420 WARN [BP-1092075347-172.31.14.131-1676656908747 heartbeating to localhost/127.0.0.1:36489] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:53,420 WARN [BP-1092075347-172.31.14.131-1676656908747 heartbeating to localhost/127.0.0.1:36489] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1092075347-172.31.14.131-1676656908747 (Datanode Uuid 26893791-b6f9-41f0-b502-44e5d9f3b750) service to localhost/127.0.0.1:36489 2023-02-17 18:01:53,421 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/cluster_ba35821f-d356-c5b9-9c66-97b05bc714d4/dfs/data/data3/current/BP-1092075347-172.31.14.131-1676656908747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:53,421 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/cluster_ba35821f-d356-c5b9-9c66-97b05bc714d4/dfs/data/data4/current/BP-1092075347-172.31.14.131-1676656908747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:53,422 WARN [Listener at localhost/41669] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:53,424 INFO [Listener at localhost/41669] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:53,528 WARN [BP-1092075347-172.31.14.131-1676656908747 heartbeating to localhost/127.0.0.1:36489] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:53,528 WARN [BP-1092075347-172.31.14.131-1676656908747 heartbeating to localhost/127.0.0.1:36489] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1092075347-172.31.14.131-1676656908747 (Datanode Uuid ba6b7e8f-c0fd-4109-bf82-ba581c79d41b) service to localhost/127.0.0.1:36489 2023-02-17 18:01:53,529 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/cluster_ba35821f-d356-c5b9-9c66-97b05bc714d4/dfs/data/data1/current/BP-1092075347-172.31.14.131-1676656908747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:53,529 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/cluster_ba35821f-d356-c5b9-9c66-97b05bc714d4/dfs/data/data2/current/BP-1092075347-172.31.14.131-1676656908747] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:53,538 INFO [Listener at localhost/41669] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:53,654 INFO [Listener at localhost/41669] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 18:01:53,671 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 18:01:53,686 INFO [Listener at localhost/41669] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 231) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:36489 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:36489 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36489 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41669 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:36489 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:36489 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:36489 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,38421,1676656909466)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41669.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:36489 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=651 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=341 (was 370), ProcessCount=172 (was 172), AvailableMemoryMB=7045 (was 7109) 2023-02-17 18:01:53,697 INFO [Listener at localhost/41669] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=651, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=172, AvailableMemoryMB=7044 2023-02-17 18:01:53,706 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/hadoop.log.dir so I do NOT create it in target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004 2023-02-17 18:01:53,707 WARN [Listener at localhost/41669] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 18:01:53,707 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/hadoop.tmp.dir so I do NOT create it in target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004 2023-02-17 18:01:53,707 WARN [Listener at localhost/41669] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5346e6ce-ef75-a93d-fe42-b0bdf8eb2fc9/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 18:01:53,707 DEBUG [Listener at localhost/41669] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004 2023-02-17 18:01:53,707 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 18:01:53,707 INFO [Listener at localhost/41669] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/cluster_86b7d8ef-f547-f853-789f-7d42e755811c, deleteOnExit=true 2023-02-17 18:01:53,707 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 18:01:53,707 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/test.cache.data in system properties and HBase conf 2023-02-17 18:01:53,707 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 18:01:53,707 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/hadoop.log.dir in system properties and HBase conf 2023-02-17 18:01:53,707 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 18:01:53,708 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 18:01:53,708 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 18:01:53,708 DEBUG [Listener at localhost/41669] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 18:01:53,708 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:53,708 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:53,708 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 18:01:53,708 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:53,708 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 18:01:53,708 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 18:01:53,708 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:53,709 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:53,709 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 18:01:53,709 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/nfs.dump.dir in system properties and HBase conf 2023-02-17 18:01:53,709 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/java.io.tmpdir in system properties and HBase conf 2023-02-17 18:01:53,709 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:53,709 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 18:01:53,709 INFO [Listener at localhost/41669] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 18:01:53,713 WARN [Listener at localhost/41669] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:53,714 WARN [Listener at localhost/41669] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:53,750 WARN [Listener at localhost/41669] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:53,752 INFO [Listener at localhost/41669] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:53,760 INFO [Listener at localhost/41669] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/java.io.tmpdir/Jetty_localhost_44487_hdfs____.gwe2sj/webapp 2023-02-17 18:01:53,883 INFO [Listener at localhost/41669] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44487 2023-02-17 18:01:53,888 WARN [Listener at localhost/41669] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:53,888 WARN [Listener at localhost/41669] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:53,941 WARN [Listener at localhost/44687] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:53,955 WARN [Listener at localhost/44687] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:53,959 WARN [Listener at localhost/44687] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:53,960 INFO [Listener at localhost/44687] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:53,965 INFO [Listener at localhost/44687] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/java.io.tmpdir/Jetty_localhost_33827_datanode____.rv4k8s/webapp 2023-02-17 18:01:54,061 INFO [Listener at localhost/44687] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33827 2023-02-17 18:01:54,076 WARN [Listener at localhost/43053] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:54,097 WARN [Listener at localhost/43053] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:54,099 WARN [Listener at localhost/43053] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:54,100 INFO [Listener at localhost/43053] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:54,103 INFO [Listener at localhost/43053] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/java.io.tmpdir/Jetty_localhost_45387_datanode____fw93g8/webapp 2023-02-17 18:01:54,196 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcf1b4e1bec9cf61f: Processing first storage report for DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d from datanode dcd09b8c-948a-4ce9-8e8e-603365271a03 2023-02-17 18:01:54,197 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcf1b4e1bec9cf61f: from storage DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d node DatanodeRegistration(127.0.0.1:34653, datanodeUuid=dcd09b8c-948a-4ce9-8e8e-603365271a03, infoPort=35549, infoSecurePort=0, ipcPort=43053, storageInfo=lv=-57;cid=testClusterID;nsid=1237739368;c=1676656913716), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-17 18:01:54,197 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcf1b4e1bec9cf61f: Processing first storage report for DS-ded4d76d-9b70-4e3d-a0c8-e8f3305dda43 from datanode dcd09b8c-948a-4ce9-8e8e-603365271a03 2023-02-17 18:01:54,197 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcf1b4e1bec9cf61f: from storage DS-ded4d76d-9b70-4e3d-a0c8-e8f3305dda43 node DatanodeRegistration(127.0.0.1:34653, datanodeUuid=dcd09b8c-948a-4ce9-8e8e-603365271a03, infoPort=35549, infoSecurePort=0, ipcPort=43053, storageInfo=lv=-57;cid=testClusterID;nsid=1237739368;c=1676656913716), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:54,224 INFO [Listener at localhost/43053] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45387 2023-02-17 18:01:54,242 WARN [Listener at localhost/36479] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:54,348 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc9d9fe5b8d5c6640: Processing first storage report for DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b from datanode 19bab8da-85ff-4ba7-a5a0-6d8baed0574b 2023-02-17 18:01:54,348 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc9d9fe5b8d5c6640: from storage DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b node DatanodeRegistration(127.0.0.1:45409, datanodeUuid=19bab8da-85ff-4ba7-a5a0-6d8baed0574b, infoPort=40083, infoSecurePort=0, ipcPort=36479, storageInfo=lv=-57;cid=testClusterID;nsid=1237739368;c=1676656913716), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:54,348 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc9d9fe5b8d5c6640: Processing first storage report for DS-a236195f-6dce-414a-bcd9-4147c49d6eb7 from datanode 19bab8da-85ff-4ba7-a5a0-6d8baed0574b 2023-02-17 18:01:54,348 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc9d9fe5b8d5c6640: from storage DS-a236195f-6dce-414a-bcd9-4147c49d6eb7 node DatanodeRegistration(127.0.0.1:45409, datanodeUuid=19bab8da-85ff-4ba7-a5a0-6d8baed0574b, infoPort=40083, infoSecurePort=0, ipcPort=36479, storageInfo=lv=-57;cid=testClusterID;nsid=1237739368;c=1676656913716), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:54,353 DEBUG [Listener at localhost/36479] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004 2023-02-17 18:01:54,354 INFO [Listener at localhost/36479] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/cluster_86b7d8ef-f547-f853-789f-7d42e755811c/zookeeper_0, clientPort=57509, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/cluster_86b7d8ef-f547-f853-789f-7d42e755811c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/cluster_86b7d8ef-f547-f853-789f-7d42e755811c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 18:01:54,355 INFO [Listener at localhost/36479] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57509 2023-02-17 18:01:54,356 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,356 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,371 INFO [Listener at localhost/36479] util.FSUtils(479): Created version file at hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1 with version=8 2023-02-17 18:01:54,371 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,372 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,373 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44687/user/jenkins/test-data/2ac28da1-bc70-1356-4767-ff522d76b05a/hbase-staging 2023-02-17 18:01:54,375 INFO [Listener at localhost/36479] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:54,375 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:54,375 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:54,375 INFO [Listener at localhost/36479] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:54,375 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:54,375 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:54,376 INFO [Listener at localhost/36479] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:54,377 INFO [Listener at localhost/36479] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35155 2023-02-17 18:01:54,377 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,378 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,379 INFO [Listener at localhost/36479] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35155 connecting to ZooKeeper ensemble=127.0.0.1:57509 2023-02-17 18:01:54,390 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:351550x0, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:54,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35155-0x100637219770000 connected 2023-02-17 18:01:54,410 DEBUG [Listener at localhost/36479] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:54,410 DEBUG [Listener at localhost/36479] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:54,411 DEBUG [Listener at localhost/36479] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:54,413 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35155 2023-02-17 18:01:54,413 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35155 2023-02-17 18:01:54,414 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35155 2023-02-17 18:01:54,414 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35155 2023-02-17 18:01:54,414 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35155 2023-02-17 18:01:54,415 INFO [Listener at localhost/36479] master.HMaster(444): hbase.rootdir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1, hbase.cluster.distributed=false 2023-02-17 18:01:54,427 INFO [Listener at localhost/36479] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:54,428 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:54,428 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:54,428 INFO [Listener at localhost/36479] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:54,428 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:54,428 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:54,428 INFO [Listener at localhost/36479] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:54,429 INFO [Listener at localhost/36479] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45495 2023-02-17 18:01:54,429 INFO [Listener at localhost/36479] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:54,430 DEBUG [Listener at localhost/36479] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:54,431 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,432 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,433 INFO [Listener at localhost/36479] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45495 connecting to ZooKeeper ensemble=127.0.0.1:57509 2023-02-17 18:01:54,435 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:454950x0, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:54,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45495-0x100637219770001 connected 2023-02-17 18:01:54,436 DEBUG [Listener at localhost/36479] zookeeper.ZKUtil(164): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:54,437 DEBUG [Listener at localhost/36479] zookeeper.ZKUtil(164): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:54,437 DEBUG [Listener at localhost/36479] zookeeper.ZKUtil(164): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:54,438 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45495 2023-02-17 18:01:54,438 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45495 2023-02-17 18:01:54,438 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45495 2023-02-17 18:01:54,439 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45495 2023-02-17 18:01:54,439 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45495 2023-02-17 18:01:54,451 INFO [Listener at localhost/36479] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:54,451 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:54,451 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:54,451 INFO [Listener at localhost/36479] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:54,451 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:54,451 INFO [Listener at localhost/36479] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:54,451 INFO [Listener at localhost/36479] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:54,452 INFO [Listener at localhost/36479] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39329 2023-02-17 18:01:54,452 INFO [Listener at localhost/36479] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:54,453 DEBUG [Listener at localhost/36479] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:54,454 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,455 INFO [Listener at localhost/36479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,456 INFO [Listener at localhost/36479] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39329 connecting to ZooKeeper ensemble=127.0.0.1:57509 2023-02-17 18:01:54,462 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:393290x0, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:54,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39329-0x100637219770002 connected 2023-02-17 18:01:54,463 DEBUG [Listener at localhost/36479] zookeeper.ZKUtil(164): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:54,463 DEBUG [Listener at localhost/36479] zookeeper.ZKUtil(164): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:54,464 DEBUG [Listener at localhost/36479] zookeeper.ZKUtil(164): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:54,465 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39329 2023-02-17 18:01:54,465 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39329 2023-02-17 18:01:54,465 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39329 2023-02-17 18:01:54,466 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39329 2023-02-17 18:01:54,467 DEBUG [Listener at localhost/36479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39329 2023-02-17 18:01:54,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:54,472 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:54,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:54,474 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:54,474 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:54,474 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:54,474 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:54,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:54,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35155,1676656914374 from backup master directory 2023-02-17 18:01:54,478 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:54,479 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:54,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:54,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:54,479 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:54,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/hbase.id with ID: 6b574cd7-c9bf-416f-b855-bc9ebc1c411f 2023-02-17 18:01:54,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:54,498 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:54,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1a435c51 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:54,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50105e30, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:54,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:54,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 18:01:54,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:54,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/data/master/store-tmp 2023-02-17 18:01:54,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:54,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:54,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:54,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:54,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:54,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:54,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:54,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:54,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/WALs/jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:54,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35155%2C1676656914374, suffix=, logDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/WALs/jenkins-hbase4.apache.org,35155,1676656914374, archiveDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/oldWALs, maxLogs=10 2023-02-17 18:01:54,538 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34653,DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d,DISK] 2023-02-17 18:01:54,539 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45409,DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b,DISK] 2023-02-17 18:01:54,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/WALs/jenkins-hbase4.apache.org,35155,1676656914374/jenkins-hbase4.apache.org%2C35155%2C1676656914374.1676656914521 2023-02-17 18:01:54,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34653,DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d,DISK], DatanodeInfoWithStorage[127.0.0.1:45409,DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b,DISK]] 2023-02-17 18:01:54,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:54,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:54,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:54,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:54,544 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:54,545 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 18:01:54,545 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 18:01:54,546 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:54,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:54,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:54,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:54,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:54,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60585129, jitterRate=-0.09721122682094574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:54,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:54,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 18:01:54,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 18:01:54,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 18:01:54,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 18:01:54,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 18:01:54,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 18:01:54,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 18:01:54,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 18:01:54,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 18:01:54,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 18:01:54,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 18:01:54,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 18:01:54,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 18:01:54,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 18:01:54,567 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:54,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 18:01:54,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 18:01:54,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 18:01:54,569 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:54,569 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:54,569 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:54,569 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:54,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35155,1676656914374, sessionid=0x100637219770000, setting cluster-up flag (Was=false) 2023-02-17 18:01:54,577 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:54,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 18:01:54,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:54,590 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:54,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 18:01:54,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:54,600 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.hbase-snapshot/.tmp 2023-02-17 18:01:54,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:54,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:54,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:54,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:54,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:54,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 18:01:54,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:54,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676656944604 2023-02-17 18:01:54,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 18:01:54,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 18:01:54,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 18:01:54,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 18:01:54,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 18:01:54,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 18:01:54,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,604 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:54,604 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 18:01:54,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 18:01:54,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 18:01:54,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 18:01:54,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 18:01:54,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 18:01:54,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656914605,5,FailOnTimeoutGroup] 2023-02-17 18:01:54,606 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:54,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656914606,5,FailOnTimeoutGroup] 2023-02-17 18:01:54,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 18:01:54,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,612 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:54,613 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:54,613 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1 2023-02-17 18:01:54,618 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:54,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:54,620 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/info 2023-02-17 18:01:54,620 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:54,620 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:54,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:54,621 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:54,622 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:54,622 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:54,622 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:54,623 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/table 2023-02-17 18:01:54,623 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:54,623 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:54,624 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740 2023-02-17 18:01:54,624 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740 2023-02-17 18:01:54,625 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:54,626 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:54,628 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:54,628 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69308601, jitterRate=0.03277863562107086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:54,628 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:54,628 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:54,628 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:54,628 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:54,628 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:54,628 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:54,628 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:54,628 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:54,629 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:54,629 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 18:01:54,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 18:01:54,631 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 18:01:54,632 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 18:01:54,669 INFO [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(952): ClusterId : 6b574cd7-c9bf-416f-b855-bc9ebc1c411f 2023-02-17 18:01:54,669 INFO [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(952): ClusterId : 6b574cd7-c9bf-416f-b855-bc9ebc1c411f 2023-02-17 18:01:54,669 DEBUG [RS:0;jenkins-hbase4:45495] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:54,669 DEBUG [RS:1;jenkins-hbase4:39329] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:54,671 DEBUG [RS:1;jenkins-hbase4:39329] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:54,671 DEBUG [RS:1;jenkins-hbase4:39329] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:54,671 DEBUG [RS:0;jenkins-hbase4:45495] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:54,671 DEBUG [RS:0;jenkins-hbase4:45495] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:54,674 DEBUG [RS:1;jenkins-hbase4:39329] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:54,675 DEBUG [RS:0;jenkins-hbase4:45495] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:54,675 DEBUG [RS:1;jenkins-hbase4:39329] zookeeper.ReadOnlyZKClient(139): Connect 0x403685ce to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:54,675 DEBUG [RS:0;jenkins-hbase4:45495] zookeeper.ReadOnlyZKClient(139): Connect 0x78bf1291 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:54,679 DEBUG [RS:0;jenkins-hbase4:45495] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7678f3f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:54,679 DEBUG [RS:1;jenkins-hbase4:39329] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ef163b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:54,679 DEBUG [RS:0;jenkins-hbase4:45495] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@724779e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:54,679 DEBUG [RS:1;jenkins-hbase4:39329] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4aceeebe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:54,692 DEBUG [RS:1;jenkins-hbase4:39329] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39329 2023-02-17 18:01:54,692 DEBUG [RS:0;jenkins-hbase4:45495] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45495 2023-02-17 18:01:54,692 INFO [RS:1;jenkins-hbase4:39329] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:54,692 INFO [RS:1;jenkins-hbase4:39329] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:54,692 INFO [RS:0;jenkins-hbase4:45495] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:54,692 INFO [RS:0;jenkins-hbase4:45495] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:54,692 DEBUG [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:54,693 DEBUG [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:54,693 INFO [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35155,1676656914374 with isa=jenkins-hbase4.apache.org/172.31.14.131:39329, startcode=1676656914450 2023-02-17 18:01:54,693 INFO [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35155,1676656914374 with isa=jenkins-hbase4.apache.org/172.31.14.131:45495, startcode=1676656914427 2023-02-17 18:01:54,693 DEBUG [RS:0;jenkins-hbase4:45495] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:54,693 DEBUG [RS:1;jenkins-hbase4:39329] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:54,695 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52231, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:54,695 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42821, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:54,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35155] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:54,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:54,697 DEBUG [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1 2023-02-17 18:01:54,697 DEBUG [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1 2023-02-17 18:01:54,697 DEBUG [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44687 2023-02-17 18:01:54,698 DEBUG [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44687 2023-02-17 18:01:54,698 DEBUG [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:54,698 DEBUG [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:54,701 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:54,702 DEBUG [RS:1;jenkins-hbase4:39329] zookeeper.ZKUtil(162): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:54,702 DEBUG [RS:0;jenkins-hbase4:45495] zookeeper.ZKUtil(162): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:54,702 WARN [RS:1;jenkins-hbase4:39329] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:54,702 WARN [RS:0;jenkins-hbase4:45495] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:54,702 INFO [RS:1;jenkins-hbase4:39329] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:54,702 INFO [RS:0;jenkins-hbase4:45495] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:54,702 DEBUG [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/WALs/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:54,702 DEBUG [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/WALs/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:54,702 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45495,1676656914427] 2023-02-17 18:01:54,703 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39329,1676656914450] 2023-02-17 18:01:54,707 DEBUG [RS:0;jenkins-hbase4:45495] zookeeper.ZKUtil(162): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:54,707 DEBUG [RS:1;jenkins-hbase4:39329] zookeeper.ZKUtil(162): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:54,707 DEBUG [RS:0;jenkins-hbase4:45495] zookeeper.ZKUtil(162): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:54,707 DEBUG [RS:1;jenkins-hbase4:39329] zookeeper.ZKUtil(162): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:54,708 DEBUG [RS:1;jenkins-hbase4:39329] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:54,708 DEBUG [RS:0;jenkins-hbase4:45495] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:54,708 INFO [RS:1;jenkins-hbase4:39329] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:54,708 INFO [RS:0;jenkins-hbase4:45495] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:54,709 INFO [RS:1;jenkins-hbase4:39329] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:54,709 INFO [RS:1;jenkins-hbase4:39329] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:54,709 INFO [RS:1;jenkins-hbase4:39329] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,712 INFO [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:54,713 INFO [RS:0;jenkins-hbase4:45495] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:54,713 INFO [RS:0;jenkins-hbase4:45495] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:54,713 INFO [RS:0;jenkins-hbase4:45495] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,715 INFO [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:54,715 INFO [RS:1;jenkins-hbase4:39329] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,716 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,717 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,717 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,717 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,717 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,717 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:54,717 INFO [RS:0;jenkins-hbase4:45495] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,717 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:1;jenkins-hbase4:39329] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:54,719 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,719 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,720 DEBUG [RS:0;jenkins-hbase4:45495] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:54,720 INFO [RS:1;jenkins-hbase4:39329] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,720 INFO [RS:1;jenkins-hbase4:39329] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,720 INFO [RS:1;jenkins-hbase4:39329] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,721 INFO [RS:0;jenkins-hbase4:45495] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,721 INFO [RS:0;jenkins-hbase4:45495] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,722 INFO [RS:0;jenkins-hbase4:45495] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,733 INFO [RS:0;jenkins-hbase4:45495] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:54,733 INFO [RS:1;jenkins-hbase4:39329] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:54,733 INFO [RS:0;jenkins-hbase4:45495] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45495,1676656914427-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,733 INFO [RS:1;jenkins-hbase4:39329] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39329,1676656914450-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,744 INFO [RS:0;jenkins-hbase4:45495] regionserver.Replication(203): jenkins-hbase4.apache.org,45495,1676656914427 started 2023-02-17 18:01:54,744 INFO [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45495,1676656914427, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45495, sessionid=0x100637219770001 2023-02-17 18:01:54,744 INFO [RS:1;jenkins-hbase4:39329] regionserver.Replication(203): jenkins-hbase4.apache.org,39329,1676656914450 started 2023-02-17 18:01:54,744 DEBUG [RS:0;jenkins-hbase4:45495] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:54,745 DEBUG [RS:0;jenkins-hbase4:45495] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:54,744 INFO [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39329,1676656914450, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39329, sessionid=0x100637219770002 2023-02-17 18:01:54,745 DEBUG [RS:0;jenkins-hbase4:45495] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45495,1676656914427' 2023-02-17 18:01:54,745 DEBUG [RS:1;jenkins-hbase4:39329] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:54,745 DEBUG [RS:1;jenkins-hbase4:39329] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:54,745 DEBUG [RS:1;jenkins-hbase4:39329] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39329,1676656914450' 2023-02-17 18:01:54,745 DEBUG [RS:1;jenkins-hbase4:39329] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:54,745 DEBUG [RS:0;jenkins-hbase4:45495] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:54,745 DEBUG [RS:0;jenkins-hbase4:45495] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:54,745 DEBUG [RS:1;jenkins-hbase4:39329] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:54,745 DEBUG [RS:0;jenkins-hbase4:45495] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:54,745 DEBUG [RS:0;jenkins-hbase4:45495] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:54,745 DEBUG [RS:0;jenkins-hbase4:45495] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:54,746 DEBUG [RS:0;jenkins-hbase4:45495] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45495,1676656914427' 2023-02-17 18:01:54,746 DEBUG [RS:0;jenkins-hbase4:45495] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:54,745 DEBUG [RS:1;jenkins-hbase4:39329] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:54,746 DEBUG [RS:1;jenkins-hbase4:39329] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:54,746 DEBUG [RS:1;jenkins-hbase4:39329] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:54,746 DEBUG [RS:1;jenkins-hbase4:39329] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39329,1676656914450' 2023-02-17 18:01:54,746 DEBUG [RS:1;jenkins-hbase4:39329] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:54,746 DEBUG [RS:0;jenkins-hbase4:45495] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:54,746 DEBUG [RS:1;jenkins-hbase4:39329] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:54,746 DEBUG [RS:0;jenkins-hbase4:45495] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:54,746 INFO [RS:0;jenkins-hbase4:45495] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:54,746 INFO [RS:0;jenkins-hbase4:45495] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:54,746 DEBUG [RS:1;jenkins-hbase4:39329] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:54,746 INFO [RS:1;jenkins-hbase4:39329] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:54,746 INFO [RS:1;jenkins-hbase4:39329] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:54,782 DEBUG [jenkins-hbase4:35155] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 18:01:54,782 DEBUG [jenkins-hbase4:35155] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:54,783 DEBUG [jenkins-hbase4:35155] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:54,783 DEBUG [jenkins-hbase4:35155] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:54,783 DEBUG [jenkins-hbase4:35155] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:54,784 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45495,1676656914427, state=OPENING 2023-02-17 18:01:54,785 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 18:01:54,787 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:54,787 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:54,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45495,1676656914427}] 2023-02-17 18:01:54,942 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:54,942 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:54,944 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42024, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:54,948 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 18:01:54,948 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:54,949 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45495%2C1676656914427.meta, suffix=.meta, logDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/WALs/jenkins-hbase4.apache.org,45495,1676656914427, archiveDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/oldWALs, maxLogs=32 2023-02-17 18:01:54,962 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34653,DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d,DISK] 2023-02-17 18:01:54,962 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45409,DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b,DISK] 2023-02-17 18:01:54,964 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/WALs/jenkins-hbase4.apache.org,45495,1676656914427/jenkins-hbase4.apache.org%2C45495%2C1676656914427.meta.1676656914949.meta 2023-02-17 18:01:54,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34653,DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d,DISK], DatanodeInfoWithStorage[127.0.0.1:45409,DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b,DISK]] 2023-02-17 18:01:54,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:54,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 18:01:54,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 18:01:54,964 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 18:01:54,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 18:01:54,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:54,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 18:01:54,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 18:01:54,965 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:54,966 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/info 2023-02-17 18:01:54,966 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/info 2023-02-17 18:01:54,966 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:54,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:54,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:54,968 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:54,968 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:54,968 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:54,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:54,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:54,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/table 2023-02-17 18:01:54,969 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/table 2023-02-17 18:01:54,969 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:54,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:54,970 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740 2023-02-17 18:01:54,971 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740 2023-02-17 18:01:54,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:54,973 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:54,974 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63872950, jitterRate=-0.048218876123428345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:54,974 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:54,974 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676656914942 2023-02-17 18:01:54,978 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 18:01:54,978 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 18:01:54,978 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45495,1676656914427, state=OPEN 2023-02-17 18:01:54,979 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 18:01:54,979 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:54,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 18:01:54,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45495,1676656914427 in 192 msec 2023-02-17 18:01:54,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 18:01:54,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-17 18:01:54,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 381 msec 2023-02-17 18:01:54,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676656914983, completionTime=-1 2023-02-17 18:01:54,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 18:01:54,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 18:01:54,985 DEBUG [hconnection-0x3feaf3c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:54,987 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42030, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:54,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 18:01:54,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676656974988 2023-02-17 18:01:54,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676657034988 2023-02-17 18:01:54,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-17 18:01:54,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35155,1676656914374-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35155,1676656914374-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35155,1676656914374-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35155, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:54,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 18:01:54,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:54,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 18:01:54,999 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 18:01:54,999 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:55,000 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:55,001 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:55,001 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a empty. 2023-02-17 18:01:55,002 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:55,002 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 18:01:55,009 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:55,010 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8423c6e68b0733a1593efa386663c81a, NAME => 'hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp 2023-02-17 18:01:55,015 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:55,015 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8423c6e68b0733a1593efa386663c81a, disabling compactions & flushes 2023-02-17 18:01:55,015 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:55,015 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:55,015 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. after waiting 0 ms 2023-02-17 18:01:55,015 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:55,016 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:55,016 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8423c6e68b0733a1593efa386663c81a: 2023-02-17 18:01:55,017 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:55,018 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656915018"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656915018"}]},"ts":"1676656915018"} 2023-02-17 18:01:55,019 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:55,020 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:55,020 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656915020"}]},"ts":"1676656915020"} 2023-02-17 18:01:55,021 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 18:01:55,025 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:55,025 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:55,025 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:55,025 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:55,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8423c6e68b0733a1593efa386663c81a, ASSIGN}] 2023-02-17 18:01:55,028 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8423c6e68b0733a1593efa386663c81a, ASSIGN 2023-02-17 18:01:55,028 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8423c6e68b0733a1593efa386663c81a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39329,1676656914450; forceNewPlan=false, retain=false 2023-02-17 18:01:55,178 INFO [jenkins-hbase4:35155] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:55,179 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8423c6e68b0733a1593efa386663c81a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:55,179 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656915179"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656915179"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656915179"}]},"ts":"1676656915179"} 2023-02-17 18:01:55,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8423c6e68b0733a1593efa386663c81a, server=jenkins-hbase4.apache.org,39329,1676656914450}] 2023-02-17 18:01:55,333 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:55,333 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:55,335 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53794, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:55,338 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:55,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39329%2C1676656914450, suffix=, logDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/WALs/jenkins-hbase4.apache.org,39329,1676656914450, archiveDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/oldWALs, maxLogs=32 2023-02-17 18:01:55,353 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45409,DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b,DISK] 2023-02-17 18:01:55,353 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34653,DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d,DISK] 2023-02-17 18:01:55,355 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/WALs/jenkins-hbase4.apache.org,39329,1676656914450/jenkins-hbase4.apache.org%2C39329%2C1676656914450.1676656915340 2023-02-17 18:01:55,356 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45409,DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b,DISK], DatanodeInfoWithStorage[127.0.0.1:34653,DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d,DISK]] 2023-02-17 18:01:55,356 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8423c6e68b0733a1593efa386663c81a, NAME => 'hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:55,356 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:55,356 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:55,356 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:55,356 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:55,360 INFO [StoreOpener-8423c6e68b0733a1593efa386663c81a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:55,361 DEBUG [StoreOpener-8423c6e68b0733a1593efa386663c81a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a/info 2023-02-17 18:01:55,361 DEBUG [StoreOpener-8423c6e68b0733a1593efa386663c81a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a/info 2023-02-17 18:01:55,361 INFO [StoreOpener-8423c6e68b0733a1593efa386663c81a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8423c6e68b0733a1593efa386663c81a columnFamilyName info 2023-02-17 18:01:55,362 INFO [StoreOpener-8423c6e68b0733a1593efa386663c81a-1] regionserver.HStore(310): Store=8423c6e68b0733a1593efa386663c81a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:55,362 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:55,363 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:55,365 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:55,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:55,367 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8423c6e68b0733a1593efa386663c81a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72231663, jitterRate=0.07633565366268158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:55,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8423c6e68b0733a1593efa386663c81a: 2023-02-17 18:01:55,368 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a., pid=6, masterSystemTime=1676656915333 2023-02-17 18:01:55,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:55,371 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:55,371 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8423c6e68b0733a1593efa386663c81a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:55,371 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656915371"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656915371"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656915371"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656915371"}]},"ts":"1676656915371"} 2023-02-17 18:01:55,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 18:01:55,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8423c6e68b0733a1593efa386663c81a, server=jenkins-hbase4.apache.org,39329,1676656914450 in 192 msec 2023-02-17 18:01:55,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 18:01:55,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8423c6e68b0733a1593efa386663c81a, ASSIGN in 349 msec 2023-02-17 18:01:55,376 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:55,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656915376"}]},"ts":"1676656915376"} 2023-02-17 18:01:55,377 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 18:01:55,379 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:55,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 382 msec 2023-02-17 18:01:55,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 18:01:55,400 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:55,400 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:55,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:55,403 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:55,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 18:01:55,412 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:55,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-17 18:01:55,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 18:01:55,421 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:01:55,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-17 18:01:55,430 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 18:01:55,432 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 18:01:55,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.953sec 2023-02-17 18:01:55,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 18:01:55,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 18:01:55,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 18:01:55,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35155,1676656914374-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 18:01:55,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35155,1676656914374-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 18:01:55,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 18:01:55,469 DEBUG [Listener at localhost/36479] zookeeper.ReadOnlyZKClient(139): Connect 0x51b45f00 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:55,473 DEBUG [Listener at localhost/36479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@650ddaa0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:55,474 DEBUG [hconnection-0x42b39840-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:55,476 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:55,477 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:55,477 DEBUG [Listener at localhost/36479] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 18:01:55,479 DEBUG [Listener at localhost/36479] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 18:01:55,481 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58764, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 18:01:55,481 INFO [Listener at localhost/36479] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:55,482 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:55,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 18:01:55,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:58764 deadline: 1676656975481, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:55,482 INFO [Listener at localhost/36479] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 18:01:55,484 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:55,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:55,486 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:55,486 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-17 18:01:55,487 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:55,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:55,488 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,488 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf empty. 2023-02-17 18:01:55,489 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,489 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-17 18:01:55,498 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:55,499 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 70737c6ebbe75ed3aed9e53ef5a7dbbf, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp 2023-02-17 18:01:55,508 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:55,508 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 70737c6ebbe75ed3aed9e53ef5a7dbbf, disabling compactions & flushes 2023-02-17 18:01:55,508 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:55,508 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:55,508 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. after waiting 0 ms 2023-02-17 18:01:55,508 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:55,508 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:55,509 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 70737c6ebbe75ed3aed9e53ef5a7dbbf: 2023-02-17 18:01:55,510 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:55,511 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676656915511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656915511"}]},"ts":"1676656915511"} 2023-02-17 18:01:55,512 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:55,513 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:55,513 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656915513"}]},"ts":"1676656915513"} 2023-02-17 18:01:55,514 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-17 18:01:55,516 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:55,517 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:55,517 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:55,517 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:55,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=70737c6ebbe75ed3aed9e53ef5a7dbbf, ASSIGN}] 2023-02-17 18:01:55,519 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=70737c6ebbe75ed3aed9e53ef5a7dbbf, ASSIGN 2023-02-17 18:01:55,520 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=70737c6ebbe75ed3aed9e53ef5a7dbbf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45495,1676656914427; forceNewPlan=false, retain=false 2023-02-17 18:01:55,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:55,632 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 18:01:55,670 INFO [jenkins-hbase4:35155] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:55,671 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=70737c6ebbe75ed3aed9e53ef5a7dbbf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:55,671 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676656915671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656915671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656915671"}]},"ts":"1676656915671"} 2023-02-17 18:01:55,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 70737c6ebbe75ed3aed9e53ef5a7dbbf, server=jenkins-hbase4.apache.org,45495,1676656914427}] 2023-02-17 18:01:55,754 INFO [RS:0;jenkins-hbase4:45495] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45495%2C1676656914427, suffix=, logDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/WALs/jenkins-hbase4.apache.org,45495,1676656914427, archiveDir=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/oldWALs, maxLogs=32 2023-02-17 18:01:55,775 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45409,DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b,DISK] 2023-02-17 18:01:55,775 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34653,DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d,DISK] 2023-02-17 18:01:55,781 INFO [RS:0;jenkins-hbase4:45495] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/WALs/jenkins-hbase4.apache.org,45495,1676656914427/jenkins-hbase4.apache.org%2C45495%2C1676656914427.1676656915754 2023-02-17 18:01:55,782 DEBUG [RS:0;jenkins-hbase4:45495] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34653,DS-aa7e4c38-2316-4e81-8e8b-7bf1241daf7d,DISK], DatanodeInfoWithStorage[127.0.0.1:45409,DS-7e47af3a-d815-4cbb-a204-bd1fd2a4c03b,DISK]] 2023-02-17 18:01:55,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:55,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:55,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 70737c6ebbe75ed3aed9e53ef5a7dbbf, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:55,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:55,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,831 INFO [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,832 DEBUG [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1 2023-02-17 18:01:55,832 DEBUG [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1 2023-02-17 18:01:55,832 INFO [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70737c6ebbe75ed3aed9e53ef5a7dbbf columnFamilyName f1 2023-02-17 18:01:55,833 INFO [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] regionserver.HStore(310): Store=70737c6ebbe75ed3aed9e53ef5a7dbbf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:55,833 INFO [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,834 DEBUG [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2 2023-02-17 18:01:55,834 DEBUG [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2 2023-02-17 18:01:55,834 INFO [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70737c6ebbe75ed3aed9e53ef5a7dbbf columnFamilyName f2 2023-02-17 18:01:55,834 INFO [StoreOpener-70737c6ebbe75ed3aed9e53ef5a7dbbf-1] regionserver.HStore(310): Store=70737c6ebbe75ed3aed9e53ef5a7dbbf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:55,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:01:55,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:55,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:55,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 70737c6ebbe75ed3aed9e53ef5a7dbbf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72700826, jitterRate=0.08332672715187073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:01:55,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 70737c6ebbe75ed3aed9e53ef5a7dbbf: 2023-02-17 18:01:55,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf., pid=12, masterSystemTime=1676656915827 2023-02-17 18:01:55,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:55,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:55,841 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=70737c6ebbe75ed3aed9e53ef5a7dbbf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:55,841 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676656915841"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656915841"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656915841"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656915841"}]},"ts":"1676656915841"} 2023-02-17 18:01:55,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 18:01:55,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 70737c6ebbe75ed3aed9e53ef5a7dbbf, server=jenkins-hbase4.apache.org,45495,1676656914427 in 167 msec 2023-02-17 18:01:55,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 18:01:55,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=70737c6ebbe75ed3aed9e53ef5a7dbbf, ASSIGN in 327 msec 2023-02-17 18:01:55,845 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:01:55,845 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656915845"}]},"ts":"1676656915845"} 2023-02-17 18:01:55,846 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-17 18:01:55,848 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:01:55,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 364 msec 2023-02-17 18:01:56,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:01:56,092 INFO [Listener at localhost/36479] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-17 18:01:56,092 DEBUG [Listener at localhost/36479] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-17 18:01:56,093 INFO [Listener at localhost/36479] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:56,095 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-17 18:01:56,095 INFO [Listener at localhost/36479] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:01:56,095 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-17 18:01:56,095 INFO [Listener at localhost/36479] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 18:01:56,140 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45495] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,234 INFO [Listener at localhost/36479] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 18:01:56,234 INFO [Listener at localhost/36479] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 18:01:56,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-17 18:01:56,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676656916235 (current time:1676656916235). 2023-02-17 18:01:56,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 18:01:56,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] zookeeper.ReadOnlyZKClient(139): Connect 0x7de771a7 to 127.0.0.1:57509 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:56,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6db174ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:56,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:56,242 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42060, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:56,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7de771a7 to 127.0.0.1:57509 2023-02-17 18:01:56,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:56,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 18:01:56,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-17 18:01:56,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-17 18:01:56,246 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-17 18:01:56,247 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676657516247 2023-02-17 18:01:56,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-17 18:01:56,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,248 DEBUG [Listener at localhost/36479] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:56,248 DEBUG [Listener at localhost/36479] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 18:01:56,249 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-17 18:01:56,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-17 18:01:56,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-17 18:01:56,251 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-17 18:01:56,251 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676657516251 2023-02-17 18:01:56,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-17 18:01:56,262 INFO [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-17 18:01:56,262 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:56,263 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-17 18:01:56,263 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-17 18:01:56,263 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,263 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:56,265 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:56,265 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:56,265 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:56,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:56,265 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,265 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 18:01:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-17 18:01:56,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-17 18:01:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-17 18:01:56,266 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-17 18:01:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:56,266 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-17 18:01:56,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 18:01:56,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-17 18:01:56,268 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 18:01:56,268 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:56,268 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-17 18:01:56,269 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:01:56,269 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 18:01:56,270 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 18:01:56,269 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-17 18:01:56,270 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-17 18:01:56,270 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39329,1676656914450' joining acquired barrier for procedure (foo) in zk 2023-02-17 18:01:56,270 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45495,1676656914427' joining acquired barrier for procedure (foo) in zk 2023-02-17 18:01:56,271 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,271 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:56,271 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,272 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,272 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:56,272 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,272 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:56,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:56,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45495,1676656914427' joining acquired barrier for procedure 'foo' on coordinator 2023-02-17 18:01:56,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16c8d7aa[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:56,274 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-17 18:01:56,274 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,276 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,276 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,276 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 18:01:56,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,276 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,276 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:56,276 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-17 18:01:56,276 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 18:01:56,276 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:01:56,276 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,276 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 18:01:56,276 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39329,1676656914450' in zk 2023-02-17 18:01:56,276 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. started... 2023-02-17 18:01:56,276 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 70737c6ebbe75ed3aed9e53ef5a7dbbf 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 18:01:56,278 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 18:01:56,278 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:56,278 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 18:01:56,291 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/.tmp/f1/feea82e2cb024fcd93c21c211676baba 2023-02-17 18:01:56,307 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/.tmp/f2/409a4e1802a14749a1ff97f87a2426bf 2023-02-17 18:01:56,311 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/.tmp/f1/feea82e2cb024fcd93c21c211676baba as hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/feea82e2cb024fcd93c21c211676baba 2023-02-17 18:01:56,316 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/feea82e2cb024fcd93c21c211676baba, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 18:01:56,317 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/.tmp/f2/409a4e1802a14749a1ff97f87a2426bf as hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/409a4e1802a14749a1ff97f87a2426bf 2023-02-17 18:01:56,322 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/409a4e1802a14749a1ff97f87a2426bf, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 18:01:56,322 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 70737c6ebbe75ed3aed9e53ef5a7dbbf in 46ms, sequenceid=5, compaction requested=false 2023-02-17 18:01:56,323 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 18:01:56,323 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 70737c6ebbe75ed3aed9e53ef5a7dbbf: 2023-02-17 18:01:56,323 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.' region-info for snapshot=foo 2023-02-17 18:01:56,323 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:01:56,323 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/feea82e2cb024fcd93c21c211676baba] hfiles 2023-02-17 18:01:56,323 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/feea82e2cb024fcd93c21c211676baba for snapshot=foo 2023-02-17 18:01:56,323 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/409a4e1802a14749a1ff97f87a2426bf] hfiles 2023-02-17 18:01:56,323 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/409a4e1802a14749a1ff97f87a2426bf for snapshot=foo 2023-02-17 18:01:56,330 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. completed. 2023-02-17 18:01:56,330 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,330 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 18:01:56,330 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 18:01:56,330 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,330 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-17 18:01:56,330 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45495,1676656914427' in zk 2023-02-17 18:01:56,332 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-17 18:01:56,332 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:56,332 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,332 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-17 18:01:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:56,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:56,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:56,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:56,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:56,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,45495,1676656914427': 2023-02-17 18:01:56,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45495,1676656914427' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-17 18:01:56,335 INFO [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-17 18:01:56,335 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:56,335 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:56,335 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-17 18:01:56,335 INFO [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 18:01:56,337 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,337 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:01:56,337 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:56,337 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,338 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:56,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:56,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,338 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,339 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:56,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:56,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:56,340 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-17 18:01:56,341 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,346 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,346 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:56,346 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:56,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:56,346 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:01:56,347 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-17 18:01:56,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:01:56,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-17 18:01:56,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:56,347 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:56,347 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,347 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-17 18:01:56,347 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,347 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,347 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,347 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-17 18:01:56,347 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-17 18:01:56,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:56,347 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:56,347 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:01:56,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:56,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:56,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.hbase-snapshot/.tmp/foo 2023-02-17 18:01:56,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:01:56,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:56,349 DEBUG [Listener at localhost/36479] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:56,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-17 18:01:56,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:01:56,351 DEBUG [Listener at localhost/36479] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 18:01:56,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.hbase-snapshot/.tmp/foo to hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.hbase-snapshot/foo 2023-02-17 18:01:56,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-17 18:01:56,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.hbase-snapshot/.tmp/foo 2023-02-17 18:01:56,376 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.hbase-snapshot/.tmp/foo 2023-02-17 18:01:56,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676656916247Consolidate snapshot: foo at 1676656916347 (+100 ms)Loading Region manifests for foo at 1676656916347Writing data manifest for foo at 1676656916350 (+3 ms)Verifying snapshot: foo at 1676656916357 (+7 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676656916376 (+19 ms) 2023-02-17 18:01:56,379 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-17 18:01:56,380 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 131 msec 2023-02-17 18:01:56,551 DEBUG [Listener at localhost/36479] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:01:56,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-17 18:01:56,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 18:01:56,552 INFO [Listener at localhost/36479] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 18:01:56,555 INFO [Listener at localhost/36479] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 18:01:56,560 INFO [Listener at localhost/36479] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 18:01:56,590 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45495] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,681 INFO [Listener at localhost/36479] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 18:01:56,686 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 18:01:56,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,688 INFO [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 18:01:56,688 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:56,689 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-17 18:01:56,689 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-17 18:01:56,690 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,690 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,691 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:56,691 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:56,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:56,691 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:56,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:56,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:56,691 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,691 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:01:56,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-17 18:01:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-17 18:01:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:01:56,693 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-17 18:01:56,694 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-17 18:01:56,694 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-17 18:01:56,694 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 18:01:56,694 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39329,1676656914450' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-17 18:01:56,694 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,694 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. started... 2023-02-17 18:01:56,694 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:01:56,695 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 70737c6ebbe75ed3aed9e53ef5a7dbbf 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 18:01:56,696 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,697 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,697 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:56,711 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/.tmp/f1/b7b82159d13c43edb7430058d5587ef5 2023-02-17 18:01:56,741 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/.tmp/f2/2aa13c4057a84c2ab353bcfd016318e2 2023-02-17 18:01:56,746 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/.tmp/f1/b7b82159d13c43edb7430058d5587ef5 as hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/b7b82159d13c43edb7430058d5587ef5 2023-02-17 18:01:56,750 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/b7b82159d13c43edb7430058d5587ef5, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 18:01:56,751 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/.tmp/f2/2aa13c4057a84c2ab353bcfd016318e2 as hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/2aa13c4057a84c2ab353bcfd016318e2 2023-02-17 18:01:56,754 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/2aa13c4057a84c2ab353bcfd016318e2, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 18:01:56,755 INFO [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 70737c6ebbe75ed3aed9e53ef5a7dbbf in 60ms, sequenceid=9, compaction requested=false 2023-02-17 18:01:56,757 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 70737c6ebbe75ed3aed9e53ef5a7dbbf: 2023-02-17 18:01:56,757 DEBUG [rs(jenkins-hbase4.apache.org,45495,1676656914427)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,757 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 18:01:56,757 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 18:01:56,757 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,757 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-17 18:01:56,757 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45495,1676656914427' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-17 18:01:56,759 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,759 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:56,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:56,759 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,759 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:01:56,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:56,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:56,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:56,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45495,1676656914427' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-17 18:01:56,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12f741ab[Count = 0] remaining members to acquire global barrier 2023-02-17 18:01:56,761 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-17 18:01:56,761 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,764 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,764 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-17 18:01:56,764 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-17 18:01:56,764 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,39329,1676656914450' in zk 2023-02-17 18:01:56,765 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,765 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-17 18:01:56,765 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-17 18:01:56,765 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,45495,1676656914427' in zk 2023-02-17 18:01:56,770 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,770 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:01:56,771 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-17 18:01:56,771 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:56,771 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,771 DEBUG [member: 'jenkins-hbase4.apache.org,45495,1676656914427' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-17 18:01:56,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:56,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:56,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:56,772 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-17 18:01:56,773 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:56,773 DEBUG [member: 'jenkins-hbase4.apache.org,39329,1676656914450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-17 18:01:56,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:56,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:56,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,45495,1676656914427': 2023-02-17 18:01:56,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45495,1676656914427' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-17 18:01:56,776 INFO [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-17 18:01:56,777 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:01:56,777 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:01:56,777 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,777 INFO [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 18:01:56,779 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,779 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,779 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,779 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:01:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:01:56,779 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:56,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:56,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:56,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,781 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:01:56,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,788 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:01:56,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,790 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,790 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:01:56,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,795 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:56,795 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:01:56,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:56,795 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:56,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:01:56,795 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:56,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:56,795 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,796 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,796 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,796 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:56,796 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,796 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,796 DEBUG [(jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:01:56,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-17 18:01:56,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 18:01:56,796 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:56,796 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:56,796 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:01:56,797 DEBUG [Listener at localhost/36479] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-17 18:01:56,797 DEBUG [Listener at localhost/36479] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 18:01:56,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:01:56,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:56,897 DEBUG [Listener at localhost/36479] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 18:01:56,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 18:01:56,902 INFO [Listener at localhost/36479] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676656916235 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:56,902 DEBUG [Listener at localhost/36479] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44687/user/jenkins/test-data/2ac28da1-bc70-1356-4767-ff522d76b05a/foo/99c9a7e5-371c-4845-ab65-fe993f9a3240/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,902 INFO [Listener at localhost/36479] snapshot.RestoreSnapshotHelper(239): region to add: 70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:56,902 INFO [Listener at localhost/36479] snapshot.RestoreSnapshotHelper(585): clone region=70737c6ebbe75ed3aed9e53ef5a7dbbf as 70737c6ebbe75ed3aed9e53ef5a7dbbf in snapshot foo 2023-02-17 18:01:56,903 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 70737c6ebbe75ed3aed9e53ef5a7dbbf, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44687/user/jenkins/test-data/2ac28da1-bc70-1356-4767-ff522d76b05a/foo/99c9a7e5-371c-4845-ab65-fe993f9a3240 2023-02-17 18:01:56,912 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:56,912 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink feea82e2cb024fcd93c21c211676baba from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,914 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 409a4e1802a14749a1ff97f87a2426bf from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,916 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 70737c6ebbe75ed3aed9e53ef5a7dbbf, disabling compactions & flushes 2023-02-17 18:01:56,916 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,916 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,916 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. after waiting 0 ms 2023-02-17 18:01:56,916 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,916 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:56,916 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 70737c6ebbe75ed3aed9e53ef5a7dbbf: 2023-02-17 18:01:56,918 INFO [Listener at localhost/36479] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676656916235 type: FLUSH version: 2 ttl: 0 2023-02-17 18:01:56,918 DEBUG [Listener at localhost/36479] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44687/user/jenkins/test-data/2ac28da1-bc70-1356-4767-ff522d76b05a/foo/99c9a7e5-371c-4845-ab65-fe993f9a3240 2023-02-17 18:01:56,918 DEBUG [Listener at localhost/36479] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44687/user/jenkins/test-data/2ac28da1-bc70-1356-4767-ff522d76b05a/foo/99c9a7e5-371c-4845-ab65-fe993f9a3240 2023-02-17 18:01:56,918 DEBUG [Listener at localhost/36479] util.CommonFSUtils(699): |-data/ 2023-02-17 18:01:56,918 DEBUG [Listener at localhost/36479] util.CommonFSUtils(699): |----default/ 2023-02-17 18:01:56,919 DEBUG [Listener at localhost/36479] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-17 18:01:56,919 DEBUG [Listener at localhost/36479] util.CommonFSUtils(699): |----------70737c6ebbe75ed3aed9e53ef5a7dbbf/ 2023-02-17 18:01:56,919 DEBUG [Listener at localhost/36479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:01:56,919 DEBUG [Listener at localhost/36479] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:01:56,920 DEBUG [Listener at localhost/36479] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=70737c6ebbe75ed3aed9e53ef5a7dbbf-feea82e2cb024fcd93c21c211676baba 2023-02-17 18:01:56,920 DEBUG [Listener at localhost/36479] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:01:56,920 DEBUG [Listener at localhost/36479] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=70737c6ebbe75ed3aed9e53ef5a7dbbf-409a4e1802a14749a1ff97f87a2426bf hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/b7b82159d13c43edb7430058d5587ef5 hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/feea82e2cb024fcd93c21c211676baba hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/2aa13c4057a84c2ab353bcfd016318e2 hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/409a4e1802a14749a1ff97f87a2426bf 2023-02-17 18:01:56,925 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-17 18:01:56,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-17 18:01:56,928 INFO [Listener at localhost/36479] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,929 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:56,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:01:56,932 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656916932"}]},"ts":"1676656916932"} 2023-02-17 18:01:56,933 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-17 18:01:56,934 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-17 18:01:56,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=70737c6ebbe75ed3aed9e53ef5a7dbbf, UNASSIGN}] 2023-02-17 18:01:56,937 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=70737c6ebbe75ed3aed9e53ef5a7dbbf, UNASSIGN 2023-02-17 18:01:56,938 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=70737c6ebbe75ed3aed9e53ef5a7dbbf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:56,938 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676656916938"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656916938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656916938"}]},"ts":"1676656916938"} 2023-02-17 18:01:56,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 70737c6ebbe75ed3aed9e53ef5a7dbbf, server=jenkins-hbase4.apache.org,45495,1676656914427}] 2023-02-17 18:01:57,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:01:57,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:57,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 70737c6ebbe75ed3aed9e53ef5a7dbbf, disabling compactions & flushes 2023-02-17 18:01:57,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:57,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:57,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. after waiting 0 ms 2023-02-17 18:01:57,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:57,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:01:57,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf. 2023-02-17 18:01:57,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 70737c6ebbe75ed3aed9e53ef5a7dbbf: 2023-02-17 18:01:57,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:57,097 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=70737c6ebbe75ed3aed9e53ef5a7dbbf, regionState=CLOSED 2023-02-17 18:01:57,097 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676656917097"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656917097"}]},"ts":"1676656917097"} 2023-02-17 18:01:57,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 18:01:57,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 70737c6ebbe75ed3aed9e53ef5a7dbbf, server=jenkins-hbase4.apache.org,45495,1676656914427 in 159 msec 2023-02-17 18:01:57,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 18:01:57,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=70737c6ebbe75ed3aed9e53ef5a7dbbf, UNASSIGN in 164 msec 2023-02-17 18:01:57,101 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656917101"}]},"ts":"1676656917101"} 2023-02-17 18:01:57,102 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-17 18:01:57,104 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-17 18:01:57,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 175 msec 2023-02-17 18:01:57,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:01:57,235 INFO [Listener at localhost/36479] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-17 18:01:57,236 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:57,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:57,238 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:57,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:57,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 18:01:57,242 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:57,243 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1, FileablePath, hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2, FileablePath, hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/recovered.edits] 2023-02-17 18:01:57,246 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/b7b82159d13c43edb7430058d5587ef5 to hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/b7b82159d13c43edb7430058d5587ef5 2023-02-17 18:01:57,247 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/feea82e2cb024fcd93c21c211676baba to hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f1/feea82e2cb024fcd93c21c211676baba 2023-02-17 18:01:57,249 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/2aa13c4057a84c2ab353bcfd016318e2 to hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/2aa13c4057a84c2ab353bcfd016318e2 2023-02-17 18:01:57,251 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/409a4e1802a14749a1ff97f87a2426bf to hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/f2/409a4e1802a14749a1ff97f87a2426bf 2023-02-17 18:01:57,253 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/recovered.edits/12.seqid to hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf/recovered.edits/12.seqid 2023-02-17 18:01:57,253 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/70737c6ebbe75ed3aed9e53ef5a7dbbf 2023-02-17 18:01:57,253 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-17 18:01:57,255 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:57,256 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-17 18:01:57,257 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-17 18:01:57,263 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:57,263 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-17 18:01:57,263 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656917263"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:57,264 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 18:01:57,264 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 70737c6ebbe75ed3aed9e53ef5a7dbbf, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676656915484.70737c6ebbe75ed3aed9e53ef5a7dbbf.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 18:01:57,264 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-17 18:01:57,265 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676656917265"}]},"ts":"9223372036854775807"} 2023-02-17 18:01:57,266 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-17 18:01:57,267 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-17 18:01:57,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 31 msec 2023-02-17 18:01:57,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 18:01:57,341 INFO [Listener at localhost/36479] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-17 18:01:57,341 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 18:01:57,341 INFO [Listener at localhost/36479] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 18:01:57,341 DEBUG [Listener at localhost/36479] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51b45f00 to 127.0.0.1:57509 2023-02-17 18:01:57,341 DEBUG [Listener at localhost/36479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:57,341 DEBUG [Listener at localhost/36479] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 18:01:57,342 DEBUG [Listener at localhost/36479] util.JVMClusterUtil(257): Found active master hash=1050343611, stopped=false 2023-02-17 18:01:57,342 INFO [Listener at localhost/36479] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:57,345 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:57,345 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:57,345 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:57,345 INFO [Listener at localhost/36479] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 18:01:57,345 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:57,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:57,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:57,349 DEBUG [Listener at localhost/36479] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a435c51 to 127.0.0.1:57509 2023-02-17 18:01:57,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:57,349 DEBUG [Listener at localhost/36479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:57,349 INFO [Listener at localhost/36479] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45495,1676656914427' ***** 2023-02-17 18:01:57,350 INFO [Listener at localhost/36479] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:57,350 INFO [Listener at localhost/36479] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39329,1676656914450' ***** 2023-02-17 18:01:57,350 INFO [Listener at localhost/36479] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:01:57,350 INFO [RS:0;jenkins-hbase4:45495] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:57,350 INFO [RS:0;jenkins-hbase4:45495] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:57,350 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:57,350 INFO [RS:0;jenkins-hbase4:45495] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:57,350 INFO [RS:1;jenkins-hbase4:39329] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:01:57,350 INFO [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:57,351 INFO [RS:1;jenkins-hbase4:39329] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:01:57,351 DEBUG [RS:0;jenkins-hbase4:45495] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78bf1291 to 127.0.0.1:57509 2023-02-17 18:01:57,351 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:01:57,351 DEBUG [RS:0;jenkins-hbase4:45495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:57,352 INFO [RS:0;jenkins-hbase4:45495] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:57,352 INFO [RS:0;jenkins-hbase4:45495] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:57,352 INFO [RS:0;jenkins-hbase4:45495] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:57,352 INFO [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 18:01:57,351 INFO [RS:1;jenkins-hbase4:39329] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:01:57,352 INFO [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 18:01:57,352 DEBUG [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-17 18:01:57,352 INFO [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(3304): Received CLOSE for 8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:57,352 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:57,352 DEBUG [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-17 18:01:57,352 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:57,352 INFO [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:57,352 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:57,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8423c6e68b0733a1593efa386663c81a, disabling compactions & flushes 2023-02-17 18:01:57,353 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:57,353 DEBUG [RS:1;jenkins-hbase4:39329] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x403685ce to 127.0.0.1:57509 2023-02-17 18:01:57,353 DEBUG [RS:1;jenkins-hbase4:39329] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:57,353 INFO [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-17 18:01:57,353 DEBUG [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1479): Online Regions={8423c6e68b0733a1593efa386663c81a=hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a.} 2023-02-17 18:01:57,353 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:57,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:57,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:57,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. after waiting 0 ms 2023-02-17 18:01:57,353 DEBUG [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1505): Waiting on 8423c6e68b0733a1593efa386663c81a 2023-02-17 18:01:57,353 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-17 18:01:57,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:57,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 8423c6e68b0733a1593efa386663c81a 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 18:01:57,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a/.tmp/info/4a6ab72d8fd7433d98b85463f735bd4f 2023-02-17 18:01:57,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a/.tmp/info/4a6ab72d8fd7433d98b85463f735bd4f as hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a/info/4a6ab72d8fd7433d98b85463f735bd4f 2023-02-17 18:01:57,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a/info/4a6ab72d8fd7433d98b85463f735bd4f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 18:01:57,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8423c6e68b0733a1593efa386663c81a in 18ms, sequenceid=6, compaction requested=false 2023-02-17 18:01:57,374 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/.tmp/info/07a34d577a0a4e99b43f36ca016eb921 2023-02-17 18:01:57,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/namespace/8423c6e68b0733a1593efa386663c81a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 18:01:57,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:57,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8423c6e68b0733a1593efa386663c81a: 2023-02-17 18:01:57,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676656914997.8423c6e68b0733a1593efa386663c81a. 2023-02-17 18:01:57,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07a34d577a0a4e99b43f36ca016eb921 2023-02-17 18:01:57,385 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/.tmp/rep_barrier/c9ec1a8cbb3e492d919cfd15122c430e 2023-02-17 18:01:57,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9ec1a8cbb3e492d919cfd15122c430e 2023-02-17 18:01:57,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/.tmp/table/a1ad2918270c481496b86da783b7ed38 2023-02-17 18:01:57,398 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1ad2918270c481496b86da783b7ed38 2023-02-17 18:01:57,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/.tmp/info/07a34d577a0a4e99b43f36ca016eb921 as hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/info/07a34d577a0a4e99b43f36ca016eb921 2023-02-17 18:01:57,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07a34d577a0a4e99b43f36ca016eb921 2023-02-17 18:01:57,402 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/info/07a34d577a0a4e99b43f36ca016eb921, entries=12, sequenceid=21, filesize=6.3 K 2023-02-17 18:01:57,402 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/.tmp/rep_barrier/c9ec1a8cbb3e492d919cfd15122c430e as hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/rep_barrier/c9ec1a8cbb3e492d919cfd15122c430e 2023-02-17 18:01:57,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9ec1a8cbb3e492d919cfd15122c430e 2023-02-17 18:01:57,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/rep_barrier/c9ec1a8cbb3e492d919cfd15122c430e, entries=1, sequenceid=21, filesize=5.1 K 2023-02-17 18:01:57,406 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/.tmp/table/a1ad2918270c481496b86da783b7ed38 as hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/table/a1ad2918270c481496b86da783b7ed38 2023-02-17 18:01:57,409 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1ad2918270c481496b86da783b7ed38 2023-02-17 18:01:57,409 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/table/a1ad2918270c481496b86da783b7ed38, entries=4, sequenceid=21, filesize=5.1 K 2023-02-17 18:01:57,410 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 57ms, sequenceid=21, compaction requested=false 2023-02-17 18:01:57,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 18:01:57,413 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 18:01:57,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:57,414 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:57,414 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:57,424 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:57,424 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:57,552 INFO [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45495,1676656914427; all regions closed. 2023-02-17 18:01:57,553 INFO [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39329,1676656914450; all regions closed. 2023-02-17 18:01:57,557 DEBUG [RS:0;jenkins-hbase4:45495] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/oldWALs 2023-02-17 18:01:57,557 DEBUG [RS:1;jenkins-hbase4:39329] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/oldWALs 2023-02-17 18:01:57,557 INFO [RS:1;jenkins-hbase4:39329] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39329%2C1676656914450:(num 1676656915340) 2023-02-17 18:01:57,557 DEBUG [RS:1;jenkins-hbase4:39329] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:57,557 INFO [RS:0;jenkins-hbase4:45495] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45495%2C1676656914427.meta:.meta(num 1676656914949) 2023-02-17 18:01:57,557 INFO [RS:1;jenkins-hbase4:39329] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:57,557 INFO [RS:1;jenkins-hbase4:39329] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:57,557 INFO [RS:1;jenkins-hbase4:39329] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:01:57,557 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:57,557 INFO [RS:1;jenkins-hbase4:39329] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:01:57,557 INFO [RS:1;jenkins-hbase4:39329] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:01:57,559 INFO [RS:1;jenkins-hbase4:39329] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39329 2023-02-17 18:01:57,563 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:57,563 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:57,563 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:57,563 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39329,1676656914450 2023-02-17 18:01:57,563 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:57,563 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39329,1676656914450] 2023-02-17 18:01:57,563 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39329,1676656914450; numProcessing=1 2023-02-17 18:01:57,564 DEBUG [RS:0;jenkins-hbase4:45495] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/oldWALs 2023-02-17 18:01:57,564 INFO [RS:0;jenkins-hbase4:45495] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45495%2C1676656914427:(num 1676656915754) 2023-02-17 18:01:57,564 DEBUG [RS:0;jenkins-hbase4:45495] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:57,565 INFO [RS:0;jenkins-hbase4:45495] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:01:57,565 INFO [RS:0;jenkins-hbase4:45495] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 18:01:57,565 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:57,565 INFO [RS:0;jenkins-hbase4:45495] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45495 2023-02-17 18:01:57,566 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39329,1676656914450 already deleted, retry=false 2023-02-17 18:01:57,566 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39329,1676656914450 expired; onlineServers=1 2023-02-17 18:01:57,567 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45495,1676656914427 2023-02-17 18:01:57,567 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:57,567 ERROR [Listener at localhost/36479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@70ab64cb rejected from java.util.concurrent.ThreadPoolExecutor@7494ee06[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:57,568 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45495,1676656914427] 2023-02-17 18:01:57,568 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45495,1676656914427; numProcessing=2 2023-02-17 18:01:57,569 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45495,1676656914427 already deleted, retry=false 2023-02-17 18:01:57,569 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45495,1676656914427 expired; onlineServers=0 2023-02-17 18:01:57,569 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35155,1676656914374' ***** 2023-02-17 18:01:57,569 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 18:01:57,570 DEBUG [M:0;jenkins-hbase4:35155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3aa57bb0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:57,570 INFO [M:0;jenkins-hbase4:35155] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35155,1676656914374 2023-02-17 18:01:57,570 INFO [M:0;jenkins-hbase4:35155] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35155,1676656914374; all regions closed. 2023-02-17 18:01:57,570 DEBUG [M:0;jenkins-hbase4:35155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:01:57,570 DEBUG [M:0;jenkins-hbase4:35155] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 18:01:57,570 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 18:01:57,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656914606] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656914606,5,FailOnTimeoutGroup] 2023-02-17 18:01:57,570 DEBUG [M:0;jenkins-hbase4:35155] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 18:01:57,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656914605] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656914605,5,FailOnTimeoutGroup] 2023-02-17 18:01:57,570 INFO [M:0;jenkins-hbase4:35155] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 18:01:57,571 INFO [M:0;jenkins-hbase4:35155] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 18:01:57,571 INFO [M:0;jenkins-hbase4:35155] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 18:01:57,571 DEBUG [M:0;jenkins-hbase4:35155] master.HMaster(1512): Stopping service threads 2023-02-17 18:01:57,571 INFO [M:0;jenkins-hbase4:35155] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 18:01:57,572 ERROR [M:0;jenkins-hbase4:35155] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 18:01:57,572 INFO [M:0;jenkins-hbase4:35155] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 18:01:57,572 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 18:01:57,572 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:57,572 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:57,572 DEBUG [M:0;jenkins-hbase4:35155] zookeeper.ZKUtil(398): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 18:01:57,572 WARN [M:0;jenkins-hbase4:35155] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 18:01:57,572 INFO [M:0;jenkins-hbase4:35155] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 18:01:57,573 INFO [M:0;jenkins-hbase4:35155] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 18:01:57,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:57,573 DEBUG [M:0;jenkins-hbase4:35155] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:57,573 INFO [M:0;jenkins-hbase4:35155] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:57,573 DEBUG [M:0;jenkins-hbase4:35155] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:57,573 DEBUG [M:0;jenkins-hbase4:35155] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:57,573 DEBUG [M:0;jenkins-hbase4:35155] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:57,573 INFO [M:0;jenkins-hbase4:35155] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.64 KB heapSize=67.60 KB 2023-02-17 18:01:57,580 INFO [M:0;jenkins-hbase4:35155] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.64 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3bb48268c4e4435a8a12cdf3d1c89e28 2023-02-17 18:01:57,585 DEBUG [M:0;jenkins-hbase4:35155] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3bb48268c4e4435a8a12cdf3d1c89e28 as hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3bb48268c4e4435a8a12cdf3d1c89e28 2023-02-17 18:01:57,588 INFO [M:0;jenkins-hbase4:35155] regionserver.HStore(1080): Added hdfs://localhost:44687/user/jenkins/test-data/54189ab5-5321-b8ec-2d9e-9bc78bdc0aa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3bb48268c4e4435a8a12cdf3d1c89e28, entries=17, sequenceid=132, filesize=8.7 K 2023-02-17 18:01:57,589 INFO [M:0;jenkins-hbase4:35155] regionserver.HRegion(2947): Finished flush of dataSize ~56.64 KB/58001, heapSize ~67.59 KB/69208, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-17 18:01:57,589 INFO [M:0;jenkins-hbase4:35155] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:57,589 DEBUG [M:0;jenkins-hbase4:35155] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:57,591 INFO [M:0;jenkins-hbase4:35155] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 18:01:57,591 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:01:57,592 INFO [M:0;jenkins-hbase4:35155] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35155 2023-02-17 18:01:57,593 DEBUG [M:0;jenkins-hbase4:35155] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35155,1676656914374 already deleted, retry=false 2023-02-17 18:01:57,746 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:57,746 INFO [M:0;jenkins-hbase4:35155] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35155,1676656914374; zookeeper connection closed. 2023-02-17 18:01:57,746 ERROR [Listener at localhost/36479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e48145b rejected from java.util.concurrent.ThreadPoolExecutor@7a779f4a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:57,747 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): master:35155-0x100637219770000, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:57,747 ERROR [Listener at localhost/36479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30d41390 rejected from java.util.concurrent.ThreadPoolExecutor@7a779f4a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:57,846 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:57,846 INFO [RS:0;jenkins-hbase4:45495] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45495,1676656914427; zookeeper connection closed. 2023-02-17 18:01:57,846 ERROR [Listener at localhost/36479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b4b1a81 rejected from java.util.concurrent.ThreadPoolExecutor@7494ee06[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:57,846 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:45495-0x100637219770001, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:57,846 ERROR [Listener at localhost/36479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53da94da rejected from java.util.concurrent.ThreadPoolExecutor@7494ee06[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:57,846 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3e75219f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3e75219f 2023-02-17 18:01:57,946 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:57,946 INFO [RS:1;jenkins-hbase4:39329] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39329,1676656914450; zookeeper connection closed. 2023-02-17 18:01:57,946 ERROR [Listener at localhost/36479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@346ed277 rejected from java.util.concurrent.ThreadPoolExecutor@30514022[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:57,946 DEBUG [Listener at localhost/36479-EventThread] zookeeper.ZKWatcher(600): regionserver:39329-0x100637219770002, quorum=127.0.0.1:57509, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:01:57,946 ERROR [Listener at localhost/36479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d38e0f rejected from java.util.concurrent.ThreadPoolExecutor@30514022[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:01:57,946 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@414ddb6b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@414ddb6b 2023-02-17 18:01:57,947 INFO [Listener at localhost/36479] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 18:01:57,947 WARN [Listener at localhost/36479] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:57,950 INFO [Listener at localhost/36479] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:58,055 WARN [BP-2146589393-172.31.14.131-1676656913716 heartbeating to localhost/127.0.0.1:44687] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:58,055 WARN [BP-2146589393-172.31.14.131-1676656913716 heartbeating to localhost/127.0.0.1:44687] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2146589393-172.31.14.131-1676656913716 (Datanode Uuid 19bab8da-85ff-4ba7-a5a0-6d8baed0574b) service to localhost/127.0.0.1:44687 2023-02-17 18:01:58,055 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/cluster_86b7d8ef-f547-f853-789f-7d42e755811c/dfs/data/data3/current/BP-2146589393-172.31.14.131-1676656913716] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:58,056 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/cluster_86b7d8ef-f547-f853-789f-7d42e755811c/dfs/data/data4/current/BP-2146589393-172.31.14.131-1676656913716] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:58,057 WARN [Listener at localhost/36479] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:01:58,059 INFO [Listener at localhost/36479] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:58,165 WARN [BP-2146589393-172.31.14.131-1676656913716 heartbeating to localhost/127.0.0.1:44687] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:01:58,165 WARN [BP-2146589393-172.31.14.131-1676656913716 heartbeating to localhost/127.0.0.1:44687] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2146589393-172.31.14.131-1676656913716 (Datanode Uuid dcd09b8c-948a-4ce9-8e8e-603365271a03) service to localhost/127.0.0.1:44687 2023-02-17 18:01:58,165 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/cluster_86b7d8ef-f547-f853-789f-7d42e755811c/dfs/data/data1/current/BP-2146589393-172.31.14.131-1676656913716] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:58,166 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/cluster_86b7d8ef-f547-f853-789f-7d42e755811c/dfs/data/data2/current/BP-2146589393-172.31.14.131-1676656913716] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:01:58,175 INFO [Listener at localhost/36479] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:01:58,291 INFO [Listener at localhost/36479] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 18:01:58,310 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 18:01:58,322 INFO [Listener at localhost/36479] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=275 (was 254) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44687 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:44687 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:44687 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:44687 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:44687 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36479 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35155,1676656914374)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:44687 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:44687 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=570 (was 651), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=322 (was 341), ProcessCount=170 (was 172), AvailableMemoryMB=6947 (was 7044) 2023-02-17 18:01:58,333 INFO [Listener at localhost/36479] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=275, OpenFileDescriptor=570, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=170, AvailableMemoryMB=6946 2023-02-17 18:01:58,343 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/hadoop.log.dir so I do NOT create it in target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403 2023-02-17 18:01:58,343 WARN [Listener at localhost/36479] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/hadoop.log.dir Erasing configuration value by system value. 2023-02-17 18:01:58,343 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/hadoop.tmp.dir so I do NOT create it in target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403 2023-02-17 18:01:58,343 WARN [Listener at localhost/36479] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/27584510-fd48-a1bf-d8ce-1f6d5afd8004/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-17 18:01:58,343 DEBUG [Listener at localhost/36479] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403 2023-02-17 18:01:58,343 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-17 18:01:58,343 INFO [Listener at localhost/36479] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/cluster_e778fa98-b067-be94-e173-932f7969e2f4, deleteOnExit=true 2023-02-17 18:01:58,343 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-17 18:01:58,344 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/test.cache.data in system properties and HBase conf 2023-02-17 18:01:58,344 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/hadoop.tmp.dir in system properties and HBase conf 2023-02-17 18:01:58,344 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/hadoop.log.dir in system properties and HBase conf 2023-02-17 18:01:58,344 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-17 18:01:58,344 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-17 18:01:58,344 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-17 18:01:58,344 DEBUG [Listener at localhost/36479] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-17 18:01:58,344 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:58,344 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/nfs.dump.dir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/java.io.tmpdir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-17 18:01:58,345 INFO [Listener at localhost/36479] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-17 18:01:58,349 WARN [Listener at localhost/36479] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:58,350 WARN [Listener at localhost/36479] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:58,388 WARN [Listener at localhost/36479] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:58,390 INFO [Listener at localhost/36479] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:58,393 INFO [Listener at localhost/36479] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/java.io.tmpdir/Jetty_localhost_35611_hdfs____.9b4rhe/webapp 2023-02-17 18:01:58,488 INFO [Listener at localhost/36479] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35611 2023-02-17 18:01:58,541 WARN [Listener at localhost/36479] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-17 18:01:58,543 WARN [Listener at localhost/36479] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-17 18:01:58,589 WARN [Listener at localhost/45441] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:58,600 WARN [Listener at localhost/45441] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:58,602 WARN [Listener at localhost/45441] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:58,603 INFO [Listener at localhost/45441] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:58,607 INFO [Listener at localhost/45441] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/java.io.tmpdir/Jetty_localhost_37667_datanode____.2vu612/webapp 2023-02-17 18:01:58,700 INFO [Listener at localhost/45441] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37667 2023-02-17 18:01:58,724 WARN [Listener at localhost/34567] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:58,740 WARN [Listener at localhost/34567] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-17 18:01:58,742 WARN [Listener at localhost/34567] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-17 18:01:58,743 INFO [Listener at localhost/34567] log.Slf4jLog(67): jetty-6.1.26 2023-02-17 18:01:58,745 INFO [Listener at localhost/34567] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/java.io.tmpdir/Jetty_localhost_34597_datanode____.rkiayv/webapp 2023-02-17 18:01:58,822 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63260a3b5a1ab12f: Processing first storage report for DS-6531898a-1da2-4db2-a3b2-ba993ed036a9 from datanode f0778ec0-033a-4d91-9f6a-ce59d1ed9b3f 2023-02-17 18:01:58,822 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63260a3b5a1ab12f: from storage DS-6531898a-1da2-4db2-a3b2-ba993ed036a9 node DatanodeRegistration(127.0.0.1:33413, datanodeUuid=f0778ec0-033a-4d91-9f6a-ce59d1ed9b3f, infoPort=32981, infoSecurePort=0, ipcPort=34567, storageInfo=lv=-57;cid=testClusterID;nsid=1027107073;c=1676656918352), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:58,822 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63260a3b5a1ab12f: Processing first storage report for DS-7aeab635-2881-46fd-a9e1-fb4236ff4083 from datanode f0778ec0-033a-4d91-9f6a-ce59d1ed9b3f 2023-02-17 18:01:58,822 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63260a3b5a1ab12f: from storage DS-7aeab635-2881-46fd-a9e1-fb4236ff4083 node DatanodeRegistration(127.0.0.1:33413, datanodeUuid=f0778ec0-033a-4d91-9f6a-ce59d1ed9b3f, infoPort=32981, infoSecurePort=0, ipcPort=34567, storageInfo=lv=-57;cid=testClusterID;nsid=1027107073;c=1676656918352), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:58,841 INFO [Listener at localhost/34567] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34597 2023-02-17 18:01:58,848 WARN [Listener at localhost/38259] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-17 18:01:58,937 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd706e12e37aa574e: Processing first storage report for DS-62ee2215-4eec-49ee-b1eb-f54719790a46 from datanode 540c498d-1741-499c-a617-b46b1c2f4072 2023-02-17 18:01:58,937 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd706e12e37aa574e: from storage DS-62ee2215-4eec-49ee-b1eb-f54719790a46 node DatanodeRegistration(127.0.0.1:42737, datanodeUuid=540c498d-1741-499c-a617-b46b1c2f4072, infoPort=36403, infoSecurePort=0, ipcPort=38259, storageInfo=lv=-57;cid=testClusterID;nsid=1027107073;c=1676656918352), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:58,937 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd706e12e37aa574e: Processing first storage report for DS-318a0c12-f74d-4f97-8d4d-0c677931b00b from datanode 540c498d-1741-499c-a617-b46b1c2f4072 2023-02-17 18:01:58,937 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd706e12e37aa574e: from storage DS-318a0c12-f74d-4f97-8d4d-0c677931b00b node DatanodeRegistration(127.0.0.1:42737, datanodeUuid=540c498d-1741-499c-a617-b46b1c2f4072, infoPort=36403, infoSecurePort=0, ipcPort=38259, storageInfo=lv=-57;cid=testClusterID;nsid=1027107073;c=1676656918352), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-17 18:01:58,956 DEBUG [Listener at localhost/38259] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403 2023-02-17 18:01:58,958 INFO [Listener at localhost/38259] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/cluster_e778fa98-b067-be94-e173-932f7969e2f4/zookeeper_0, clientPort=52396, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/cluster_e778fa98-b067-be94-e173-932f7969e2f4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/cluster_e778fa98-b067-be94-e173-932f7969e2f4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-17 18:01:58,959 INFO [Listener at localhost/38259] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52396 2023-02-17 18:01:58,959 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:58,960 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:58,972 INFO [Listener at localhost/38259] util.FSUtils(479): Created version file at hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8 with version=8 2023-02-17 18:01:58,972 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:58,973 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:58,974 INFO [Listener at localhost/38259] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45441/user/jenkins/test-data/ca0f5805-e9a6-57f4-3f33-f09613c56d59/hbase-staging 2023-02-17 18:01:58,975 INFO [Listener at localhost/38259] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:58,975 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:58,976 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:58,976 INFO [Listener at localhost/38259] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:58,976 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:58,976 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:58,976 INFO [Listener at localhost/38259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:58,977 INFO [Listener at localhost/38259] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45011 2023-02-17 18:01:58,977 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:58,978 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:58,978 INFO [Listener at localhost/38259] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45011 connecting to ZooKeeper ensemble=127.0.0.1:52396 2023-02-17 18:01:58,988 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:450110x0, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:58,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45011-0x10063722b720000 connected 2023-02-17 18:01:59,003 DEBUG [Listener at localhost/38259] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:59,003 DEBUG [Listener at localhost/38259] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:59,004 DEBUG [Listener at localhost/38259] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:59,004 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45011 2023-02-17 18:01:59,004 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45011 2023-02-17 18:01:59,004 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45011 2023-02-17 18:01:59,005 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45011 2023-02-17 18:01:59,005 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45011 2023-02-17 18:01:59,005 INFO [Listener at localhost/38259] master.HMaster(444): hbase.rootdir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8, hbase.cluster.distributed=false 2023-02-17 18:01:59,017 INFO [Listener at localhost/38259] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:59,018 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:59,018 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:59,018 INFO [Listener at localhost/38259] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:59,018 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:59,018 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:59,018 INFO [Listener at localhost/38259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:59,019 INFO [Listener at localhost/38259] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46487 2023-02-17 18:01:59,019 INFO [Listener at localhost/38259] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:59,024 DEBUG [Listener at localhost/38259] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:59,024 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:59,025 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:59,026 INFO [Listener at localhost/38259] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46487 connecting to ZooKeeper ensemble=127.0.0.1:52396 2023-02-17 18:01:59,029 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:464870x0, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:59,029 DEBUG [Listener at localhost/38259] zookeeper.ZKUtil(164): regionserver:464870x0, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:59,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46487-0x10063722b720001 connected 2023-02-17 18:01:59,032 DEBUG [Listener at localhost/38259] zookeeper.ZKUtil(164): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:59,033 DEBUG [Listener at localhost/38259] zookeeper.ZKUtil(164): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:59,033 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46487 2023-02-17 18:01:59,033 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46487 2023-02-17 18:01:59,034 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46487 2023-02-17 18:01:59,034 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46487 2023-02-17 18:01:59,034 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46487 2023-02-17 18:01:59,047 INFO [Listener at localhost/38259] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-17 18:01:59,048 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:59,048 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:59,048 INFO [Listener at localhost/38259] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-17 18:01:59,048 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-17 18:01:59,048 INFO [Listener at localhost/38259] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-17 18:01:59,048 INFO [Listener at localhost/38259] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-17 18:01:59,049 INFO [Listener at localhost/38259] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45345 2023-02-17 18:01:59,050 INFO [Listener at localhost/38259] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-17 18:01:59,052 DEBUG [Listener at localhost/38259] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:01:59,053 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:59,054 INFO [Listener at localhost/38259] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:59,055 INFO [Listener at localhost/38259] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45345 connecting to ZooKeeper ensemble=127.0.0.1:52396 2023-02-17 18:01:59,057 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:453450x0, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-17 18:01:59,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45345-0x10063722b720002 connected 2023-02-17 18:01:59,058 DEBUG [Listener at localhost/38259] zookeeper.ZKUtil(164): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:01:59,059 DEBUG [Listener at localhost/38259] zookeeper.ZKUtil(164): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:01:59,059 DEBUG [Listener at localhost/38259] zookeeper.ZKUtil(164): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-17 18:01:59,064 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45345 2023-02-17 18:01:59,064 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45345 2023-02-17 18:01:59,068 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45345 2023-02-17 18:01:59,087 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45345 2023-02-17 18:01:59,087 DEBUG [Listener at localhost/38259] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45345 2023-02-17 18:01:59,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:01:59,092 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:59,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:01:59,094 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:59,094 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:59,094 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-17 18:01:59,096 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:59,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:59,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-17 18:01:59,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45011,1676656918975 from backup master directory 2023-02-17 18:01:59,101 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:01:59,101 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-17 18:01:59,101 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:59,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:01:59,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/hbase.id with ID: 851cea17-eec3-4262-a51c-6ecb61ee9e9b 2023-02-17 18:01:59,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-17 18:01:59,129 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:59,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x66571faf to 127.0.0.1:52396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:59,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3972914b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:59,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:59,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-17 18:01:59,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:59,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/data/master/store-tmp 2023-02-17 18:01:59,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:59,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:01:59,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:59,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:59,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:01:59,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:59,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:01:59,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:59,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/WALs/jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:01:59,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45011%2C1676656918975, suffix=, logDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/WALs/jenkins-hbase4.apache.org,45011,1676656918975, archiveDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/oldWALs, maxLogs=10 2023-02-17 18:01:59,170 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33413,DS-6531898a-1da2-4db2-a3b2-ba993ed036a9,DISK] 2023-02-17 18:01:59,170 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42737,DS-62ee2215-4eec-49ee-b1eb-f54719790a46,DISK] 2023-02-17 18:01:59,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/WALs/jenkins-hbase4.apache.org,45011,1676656918975/jenkins-hbase4.apache.org%2C45011%2C1676656918975.1676656919157 2023-02-17 18:01:59,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33413,DS-6531898a-1da2-4db2-a3b2-ba993ed036a9,DISK], DatanodeInfoWithStorage[127.0.0.1:42737,DS-62ee2215-4eec-49ee-b1eb-f54719790a46,DISK]] 2023-02-17 18:01:59,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:59,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:59,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:59,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:59,176 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:59,177 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-17 18:01:59,177 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-17 18:01:59,178 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:59,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:59,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:59,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-17 18:01:59,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:59,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61953561, jitterRate=-0.0768200010061264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:01:59,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:01:59,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-17 18:01:59,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-17 18:01:59,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-17 18:01:59,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-17 18:01:59,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-17 18:01:59,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-17 18:01:59,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-17 18:01:59,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-17 18:01:59,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-17 18:01:59,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-17 18:01:59,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-17 18:01:59,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-17 18:01:59,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-17 18:01:59,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-17 18:01:59,203 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:59,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-17 18:01:59,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-17 18:01:59,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-17 18:01:59,206 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:59,206 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:59,206 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-17 18:01:59,207 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:59,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45011,1676656918975, sessionid=0x10063722b720000, setting cluster-up flag (Was=false) 2023-02-17 18:01:59,211 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:59,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-17 18:01:59,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:01:59,219 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:59,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-17 18:01:59,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:01:59,225 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.hbase-snapshot/.tmp 2023-02-17 18:01:59,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:59,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:59,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:59,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:59,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-17 18:01:59,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-17 18:01:59,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:59,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676656949231 2023-02-17 18:01:59,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-17 18:01:59,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-17 18:01:59,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-17 18:01:59,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-17 18:01:59,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-17 18:01:59,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-17 18:01:59,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,232 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:59,233 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-17 18:01:59,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-17 18:01:59,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-17 18:01:59,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-17 18:01:59,234 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:59,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-17 18:01:59,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-17 18:01:59,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656919240,5,FailOnTimeoutGroup] 2023-02-17 18:01:59,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656919240,5,FailOnTimeoutGroup] 2023-02-17 18:01:59,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-17 18:01:59,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,246 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:59,246 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:59,246 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8 2023-02-17 18:01:59,260 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:59,261 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:59,262 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/info 2023-02-17 18:01:59,262 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:59,263 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:59,263 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:59,264 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:59,265 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:59,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:59,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:59,267 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/table 2023-02-17 18:01:59,267 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:59,267 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:59,268 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740 2023-02-17 18:01:59,268 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740 2023-02-17 18:01:59,269 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:59,270 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:59,272 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:01:59,273 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70124254, jitterRate=0.044932812452316284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:59,273 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:59,273 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:01:59,273 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:01:59,273 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:01:59,273 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:01:59,273 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:01:59,273 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:01:59,273 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:01:59,274 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-17 18:01:59,274 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-17 18:01:59,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-17 18:01:59,275 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-17 18:01:59,277 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-17 18:01:59,290 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(952): ClusterId : 851cea17-eec3-4262-a51c-6ecb61ee9e9b 2023-02-17 18:01:59,290 INFO [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(952): ClusterId : 851cea17-eec3-4262-a51c-6ecb61ee9e9b 2023-02-17 18:01:59,290 DEBUG [RS:1;jenkins-hbase4:45345] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:59,290 DEBUG [RS:0;jenkins-hbase4:46487] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-17 18:01:59,292 DEBUG [RS:0;jenkins-hbase4:46487] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:59,293 DEBUG [RS:0;jenkins-hbase4:46487] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:59,292 DEBUG [RS:1;jenkins-hbase4:45345] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-17 18:01:59,293 DEBUG [RS:1;jenkins-hbase4:45345] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-17 18:01:59,296 DEBUG [RS:0;jenkins-hbase4:46487] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:59,297 DEBUG [RS:0;jenkins-hbase4:46487] zookeeper.ReadOnlyZKClient(139): Connect 0x1ef16fc3 to 127.0.0.1:52396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:59,297 DEBUG [RS:1;jenkins-hbase4:45345] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-17 18:01:59,299 DEBUG [RS:1;jenkins-hbase4:45345] zookeeper.ReadOnlyZKClient(139): Connect 0x106db4a3 to 127.0.0.1:52396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:01:59,316 DEBUG [RS:0;jenkins-hbase4:46487] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1036826d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:59,316 DEBUG [RS:0;jenkins-hbase4:46487] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@140904b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:59,324 DEBUG [RS:1;jenkins-hbase4:45345] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1eaa48de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:01:59,324 DEBUG [RS:1;jenkins-hbase4:45345] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a95dfd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:01:59,329 DEBUG [RS:0;jenkins-hbase4:46487] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46487 2023-02-17 18:01:59,329 INFO [RS:0;jenkins-hbase4:46487] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:59,329 INFO [RS:0;jenkins-hbase4:46487] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:59,329 DEBUG [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:59,330 INFO [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45011,1676656918975 with isa=jenkins-hbase4.apache.org/172.31.14.131:46487, startcode=1676656919017 2023-02-17 18:01:59,330 DEBUG [RS:0;jenkins-hbase4:46487] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:59,332 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55261, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:59,332 DEBUG [RS:1;jenkins-hbase4:45345] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45345 2023-02-17 18:01:59,332 INFO [RS:1;jenkins-hbase4:45345] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-17 18:01:59,332 INFO [RS:1;jenkins-hbase4:45345] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-17 18:01:59,332 DEBUG [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1023): About to register with Master. 2023-02-17 18:01:59,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:01:59,334 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45011,1676656918975 with isa=jenkins-hbase4.apache.org/172.31.14.131:45345, startcode=1676656919047 2023-02-17 18:01:59,334 DEBUG [RS:1;jenkins-hbase4:45345] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-17 18:01:59,334 DEBUG [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8 2023-02-17 18:01:59,334 DEBUG [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45441 2023-02-17 18:01:59,334 DEBUG [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:59,335 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47809, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-17 18:01:59,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:01:59,336 DEBUG [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8 2023-02-17 18:01:59,336 DEBUG [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45441 2023-02-17 18:01:59,336 DEBUG [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-17 18:01:59,337 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:01:59,341 DEBUG [RS:0;jenkins-hbase4:46487] zookeeper.ZKUtil(162): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:01:59,341 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45345,1676656919047] 2023-02-17 18:01:59,341 WARN [RS:0;jenkins-hbase4:46487] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:59,341 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46487,1676656919017] 2023-02-17 18:01:59,341 DEBUG [RS:1;jenkins-hbase4:45345] zookeeper.ZKUtil(162): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:01:59,341 INFO [RS:0;jenkins-hbase4:46487] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:59,341 WARN [RS:1;jenkins-hbase4:45345] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-17 18:01:59,341 DEBUG [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/WALs/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:01:59,341 INFO [RS:1;jenkins-hbase4:45345] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:59,341 DEBUG [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/WALs/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:01:59,350 DEBUG [RS:1;jenkins-hbase4:45345] zookeeper.ZKUtil(162): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:01:59,350 DEBUG [RS:0;jenkins-hbase4:46487] zookeeper.ZKUtil(162): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:01:59,350 DEBUG [RS:1;jenkins-hbase4:45345] zookeeper.ZKUtil(162): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:01:59,350 DEBUG [RS:0;jenkins-hbase4:46487] zookeeper.ZKUtil(162): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:01:59,351 DEBUG [RS:1;jenkins-hbase4:45345] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:59,351 DEBUG [RS:0;jenkins-hbase4:46487] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-17 18:01:59,351 INFO [RS:1;jenkins-hbase4:45345] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:59,351 INFO [RS:0;jenkins-hbase4:46487] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-17 18:01:59,352 INFO [RS:1;jenkins-hbase4:45345] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:59,352 INFO [RS:1;jenkins-hbase4:45345] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:59,352 INFO [RS:1;jenkins-hbase4:45345] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,352 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:59,356 INFO [RS:1;jenkins-hbase4:45345] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,356 INFO [RS:0;jenkins-hbase4:46487] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,356 INFO [RS:0;jenkins-hbase4:46487] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:59,356 INFO [RS:0;jenkins-hbase4:46487] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,356 DEBUG [RS:1;jenkins-hbase4:45345] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,356 INFO [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-17 18:01:59,357 INFO [RS:1;jenkins-hbase4:45345] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,357 INFO [RS:1;jenkins-hbase4:45345] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,357 INFO [RS:1;jenkins-hbase4:45345] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,360 INFO [RS:0;jenkins-hbase4:46487] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,360 DEBUG [RS:0;jenkins-hbase4:46487] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-17 18:01:59,362 INFO [RS:0;jenkins-hbase4:46487] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,362 INFO [RS:0;jenkins-hbase4:46487] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,363 INFO [RS:0;jenkins-hbase4:46487] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,372 INFO [RS:1;jenkins-hbase4:45345] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:59,372 INFO [RS:1;jenkins-hbase4:45345] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45345,1676656919047-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,374 INFO [RS:0;jenkins-hbase4:46487] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-17 18:01:59,374 INFO [RS:0;jenkins-hbase4:46487] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46487,1676656919017-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,382 INFO [RS:1;jenkins-hbase4:45345] regionserver.Replication(203): jenkins-hbase4.apache.org,45345,1676656919047 started 2023-02-17 18:01:59,382 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45345,1676656919047, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45345, sessionid=0x10063722b720002 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45345,1676656919047' 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45345,1676656919047' 2023-02-17 18:01:59,382 DEBUG [RS:1;jenkins-hbase4:45345] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:59,383 DEBUG [RS:1;jenkins-hbase4:45345] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:59,383 DEBUG [RS:1;jenkins-hbase4:45345] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:59,383 INFO [RS:1;jenkins-hbase4:45345] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:59,383 INFO [RS:1;jenkins-hbase4:45345] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:59,385 INFO [RS:0;jenkins-hbase4:46487] regionserver.Replication(203): jenkins-hbase4.apache.org,46487,1676656919017 started 2023-02-17 18:01:59,385 INFO [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46487,1676656919017, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46487, sessionid=0x10063722b720001 2023-02-17 18:01:59,385 DEBUG [RS:0;jenkins-hbase4:46487] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-17 18:01:59,385 DEBUG [RS:0;jenkins-hbase4:46487] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:01:59,385 DEBUG [RS:0;jenkins-hbase4:46487] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46487,1676656919017' 2023-02-17 18:01:59,385 DEBUG [RS:0;jenkins-hbase4:46487] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:01:59,385 DEBUG [RS:0;jenkins-hbase4:46487] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:01:59,386 DEBUG [RS:0;jenkins-hbase4:46487] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-17 18:01:59,386 DEBUG [RS:0;jenkins-hbase4:46487] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-17 18:01:59,386 DEBUG [RS:0;jenkins-hbase4:46487] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:01:59,386 DEBUG [RS:0;jenkins-hbase4:46487] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46487,1676656919017' 2023-02-17 18:01:59,386 DEBUG [RS:0;jenkins-hbase4:46487] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:01:59,386 DEBUG [RS:0;jenkins-hbase4:46487] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:01:59,386 DEBUG [RS:0;jenkins-hbase4:46487] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-17 18:01:59,386 INFO [RS:0;jenkins-hbase4:46487] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-17 18:01:59,386 INFO [RS:0;jenkins-hbase4:46487] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-17 18:01:59,427 DEBUG [jenkins-hbase4:45011] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-17 18:01:59,428 DEBUG [jenkins-hbase4:45011] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:59,429 DEBUG [jenkins-hbase4:45011] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:59,429 DEBUG [jenkins-hbase4:45011] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:59,429 DEBUG [jenkins-hbase4:45011] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:59,429 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45345,1676656919047, state=OPENING 2023-02-17 18:01:59,430 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-17 18:01:59,431 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:01:59,432 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:59,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45345,1676656919047}] 2023-02-17 18:01:59,587 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:01:59,587 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-17 18:01:59,588 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58080, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-17 18:01:59,592 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-17 18:01:59,592 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-17 18:01:59,594 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45345%2C1676656919047.meta, suffix=.meta, logDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/WALs/jenkins-hbase4.apache.org,45345,1676656919047, archiveDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/oldWALs, maxLogs=32 2023-02-17 18:01:59,614 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33413,DS-6531898a-1da2-4db2-a3b2-ba993ed036a9,DISK] 2023-02-17 18:01:59,620 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42737,DS-62ee2215-4eec-49ee-b1eb-f54719790a46,DISK] 2023-02-17 18:01:59,632 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/WALs/jenkins-hbase4.apache.org,45345,1676656919047/jenkins-hbase4.apache.org%2C45345%2C1676656919047.meta.1676656919594.meta 2023-02-17 18:01:59,632 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33413,DS-6531898a-1da2-4db2-a3b2-ba993ed036a9,DISK], DatanodeInfoWithStorage[127.0.0.1:42737,DS-62ee2215-4eec-49ee-b1eb-f54719790a46,DISK]] 2023-02-17 18:01:59,633 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:01:59,633 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-17 18:01:59,633 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-17 18:01:59,633 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-17 18:01:59,633 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-17 18:01:59,633 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:59,633 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-17 18:01:59,634 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-17 18:01:59,635 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-17 18:01:59,636 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/info 2023-02-17 18:01:59,636 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/info 2023-02-17 18:01:59,636 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-17 18:01:59,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:59,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-17 18:01:59,638 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:59,638 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/rep_barrier 2023-02-17 18:01:59,639 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-17 18:01:59,639 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:59,639 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-17 18:01:59,640 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/table 2023-02-17 18:01:59,640 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/table 2023-02-17 18:01:59,640 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-17 18:01:59,641 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:01:59,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740 2023-02-17 18:01:59,642 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740 2023-02-17 18:01:59,645 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-17 18:01:59,646 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-17 18:01:59,647 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75041342, jitterRate=0.11820313334465027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-17 18:01:59,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-17 18:01:59,648 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676656919586 2023-02-17 18:01:59,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-17 18:01:59,655 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-17 18:01:59,655 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45345,1676656919047, state=OPEN 2023-02-17 18:01:59,657 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-17 18:01:59,657 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-17 18:01:59,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-17 18:01:59,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45345,1676656919047 in 225 msec 2023-02-17 18:01:59,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-17 18:01:59,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 385 msec 2023-02-17 18:01:59,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 435 msec 2023-02-17 18:01:59,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676656919662, completionTime=-1 2023-02-17 18:01:59,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-17 18:01:59,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-17 18:01:59,682 DEBUG [hconnection-0x7710fde6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:01:59,684 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58094, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:01:59,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-17 18:01:59,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676656979685 2023-02-17 18:01:59,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676657039685 2023-02-17 18:01:59,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 23 msec 2023-02-17 18:01:59,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45011,1676656918975-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45011,1676656918975-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45011,1676656918975-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45011, period=300000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-17 18:01:59,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-17 18:01:59,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-17 18:01:59,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-17 18:01:59,697 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:01:59,697 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-17 18:01:59,698 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:01:59,700 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:01:59,700 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d empty. 2023-02-17 18:01:59,701 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:01:59,701 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-17 18:01:59,724 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-17 18:01:59,728 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 743bc2b68fcce9eebf257079733cf72d, NAME => 'hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp 2023-02-17 18:01:59,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:01:59,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 743bc2b68fcce9eebf257079733cf72d, disabling compactions & flushes 2023-02-17 18:01:59,755 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:01:59,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:01:59,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. after waiting 0 ms 2023-02-17 18:01:59,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:01:59,755 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:01:59,755 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 743bc2b68fcce9eebf257079733cf72d: 2023-02-17 18:01:59,757 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:01:59,759 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656919759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656919759"}]},"ts":"1676656919759"} 2023-02-17 18:01:59,761 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:01:59,762 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:01:59,762 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656919762"}]},"ts":"1676656919762"} 2023-02-17 18:01:59,763 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-17 18:01:59,767 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:01:59,767 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:01:59,768 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:01:59,768 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:01:59,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=743bc2b68fcce9eebf257079733cf72d, ASSIGN}] 2023-02-17 18:01:59,774 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=743bc2b68fcce9eebf257079733cf72d, ASSIGN 2023-02-17 18:01:59,774 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=743bc2b68fcce9eebf257079733cf72d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45345,1676656919047; forceNewPlan=false, retain=false 2023-02-17 18:01:59,925 INFO [jenkins-hbase4:45011] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:01:59,925 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=743bc2b68fcce9eebf257079733cf72d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:01:59,925 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656919925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656919925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656919925"}]},"ts":"1676656919925"} 2023-02-17 18:01:59,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 743bc2b68fcce9eebf257079733cf72d, server=jenkins-hbase4.apache.org,45345,1676656919047}] 2023-02-17 18:02:00,081 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:02:00,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45345%2C1676656919047, suffix=, logDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/WALs/jenkins-hbase4.apache.org,45345,1676656919047, archiveDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/oldWALs, maxLogs=32 2023-02-17 18:02:00,096 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33413,DS-6531898a-1da2-4db2-a3b2-ba993ed036a9,DISK] 2023-02-17 18:02:00,096 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42737,DS-62ee2215-4eec-49ee-b1eb-f54719790a46,DISK] 2023-02-17 18:02:00,097 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/WALs/jenkins-hbase4.apache.org,45345,1676656919047/jenkins-hbase4.apache.org%2C45345%2C1676656919047.1676656920083 2023-02-17 18:02:00,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33413,DS-6531898a-1da2-4db2-a3b2-ba993ed036a9,DISK], DatanodeInfoWithStorage[127.0.0.1:42737,DS-62ee2215-4eec-49ee-b1eb-f54719790a46,DISK]] 2023-02-17 18:02:00,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 743bc2b68fcce9eebf257079733cf72d, NAME => 'hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:02:00,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:02:00,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:02:00,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:02:00,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:02:00,099 INFO [StoreOpener-743bc2b68fcce9eebf257079733cf72d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:02:00,100 DEBUG [StoreOpener-743bc2b68fcce9eebf257079733cf72d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d/info 2023-02-17 18:02:00,100 DEBUG [StoreOpener-743bc2b68fcce9eebf257079733cf72d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d/info 2023-02-17 18:02:00,100 INFO [StoreOpener-743bc2b68fcce9eebf257079733cf72d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 743bc2b68fcce9eebf257079733cf72d columnFamilyName info 2023-02-17 18:02:00,101 INFO [StoreOpener-743bc2b68fcce9eebf257079733cf72d-1] regionserver.HStore(310): Store=743bc2b68fcce9eebf257079733cf72d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:02:00,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:02:00,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:02:00,104 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:02:00,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:02:00,106 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 743bc2b68fcce9eebf257079733cf72d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63181451, jitterRate=-0.058523014187812805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-17 18:02:00,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 743bc2b68fcce9eebf257079733cf72d: 2023-02-17 18:02:00,107 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d., pid=6, masterSystemTime=1676656920078 2023-02-17 18:02:00,108 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:02:00,109 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:02:00,110 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=743bc2b68fcce9eebf257079733cf72d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:00,110 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676656920110"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656920110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656920110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656920110"}]},"ts":"1676656920110"} 2023-02-17 18:02:00,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-17 18:02:00,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 743bc2b68fcce9eebf257079733cf72d, server=jenkins-hbase4.apache.org,45345,1676656919047 in 184 msec 2023-02-17 18:02:00,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-17 18:02:00,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=743bc2b68fcce9eebf257079733cf72d, ASSIGN in 344 msec 2023-02-17 18:02:00,114 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:02:00,114 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656920114"}]},"ts":"1676656920114"} 2023-02-17 18:02:00,115 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-17 18:02:00,118 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:02:00,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 424 msec 2023-02-17 18:02:00,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-17 18:02:00,198 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:02:00,198 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:02:00,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-17 18:02:00,207 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:02:00,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-17 18:02:00,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-17 18:02:00,217 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-17 18:02:00,221 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-17 18:02:00,225 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-17 18:02:00,233 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-17 18:02:00,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.131sec 2023-02-17 18:02:00,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-17 18:02:00,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-17 18:02:00,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-17 18:02:00,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45011,1676656918975-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-17 18:02:00,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45011,1676656918975-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-17 18:02:00,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-17 18:02:00,290 DEBUG [Listener at localhost/38259] zookeeper.ReadOnlyZKClient(139): Connect 0x07e4b6d0 to 127.0.0.1:52396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:02:00,294 DEBUG [Listener at localhost/38259] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26e1814c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:02:00,295 DEBUG [hconnection-0x3862ddd2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:02:00,296 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58098, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:02:00,298 INFO [Listener at localhost/38259] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:02:00,298 DEBUG [Listener at localhost/38259] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-17 18:02:00,300 DEBUG [Listener at localhost/38259] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-17 18:02:00,301 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-17 18:02:00,301 INFO [Listener at localhost/38259] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 18:02:00,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 18:02:00,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-17 18:02:00,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:40436 deadline: 1676656980302, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-17 18:02:00,302 INFO [Listener at localhost/38259] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-17 18:02:00,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-17 18:02:00,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-17 18:02:00,306 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-17 18:02:00,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-17 18:02:00,306 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-17 18:02:00,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:02:00,308 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,308 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3 empty. 2023-02-17 18:02:00,308 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 18:02:00,316 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-17 18:02:00,317 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 652ade1f8470ca94c969d73a150c5cd3, NAME => 'testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp 2023-02-17 18:02:00,322 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:02:00,322 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 652ade1f8470ca94c969d73a150c5cd3, disabling compactions & flushes 2023-02-17 18:02:00,322 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:00,322 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:00,322 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. after waiting 0 ms 2023-02-17 18:02:00,322 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:00,322 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:00,322 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 652ade1f8470ca94c969d73a150c5cd3: 2023-02-17 18:02:00,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-17 18:02:00,324 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676656920324"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656920324"}]},"ts":"1676656920324"} 2023-02-17 18:02:00,325 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-17 18:02:00,326 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-17 18:02:00,326 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656920326"}]},"ts":"1676656920326"} 2023-02-17 18:02:00,326 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-17 18:02:00,329 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-17 18:02:00,330 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-17 18:02:00,330 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-17 18:02:00,330 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-17 18:02:00,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=652ade1f8470ca94c969d73a150c5cd3, ASSIGN}] 2023-02-17 18:02:00,331 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=652ade1f8470ca94c969d73a150c5cd3, ASSIGN 2023-02-17 18:02:00,331 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=652ade1f8470ca94c969d73a150c5cd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45345,1676656919047; forceNewPlan=false, retain=false 2023-02-17 18:02:00,388 INFO [RS:0;jenkins-hbase4:46487] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46487%2C1676656919017, suffix=, logDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/WALs/jenkins-hbase4.apache.org,46487,1676656919017, archiveDir=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/oldWALs, maxLogs=32 2023-02-17 18:02:00,402 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42737,DS-62ee2215-4eec-49ee-b1eb-f54719790a46,DISK] 2023-02-17 18:02:00,403 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33413,DS-6531898a-1da2-4db2-a3b2-ba993ed036a9,DISK] 2023-02-17 18:02:00,404 INFO [RS:0;jenkins-hbase4:46487] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/WALs/jenkins-hbase4.apache.org,46487,1676656919017/jenkins-hbase4.apache.org%2C46487%2C1676656919017.1676656920388 2023-02-17 18:02:00,404 DEBUG [RS:0;jenkins-hbase4:46487] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42737,DS-62ee2215-4eec-49ee-b1eb-f54719790a46,DISK], DatanodeInfoWithStorage[127.0.0.1:33413,DS-6531898a-1da2-4db2-a3b2-ba993ed036a9,DISK]] 2023-02-17 18:02:00,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:02:00,482 INFO [jenkins-hbase4:45011] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-17 18:02:00,482 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=652ade1f8470ca94c969d73a150c5cd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:00,482 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676656920482"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656920482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656920482"}]},"ts":"1676656920482"} 2023-02-17 18:02:00,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 652ade1f8470ca94c969d73a150c5cd3, server=jenkins-hbase4.apache.org,45345,1676656919047}] 2023-02-17 18:02:00,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:02:00,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:00,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 652ade1f8470ca94c969d73a150c5cd3, NAME => 'testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.', STARTKEY => '', ENDKEY => ''} 2023-02-17 18:02:00,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:02:00,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,639 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,640 DEBUG [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1 2023-02-17 18:02:00,640 DEBUG [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1 2023-02-17 18:02:00,640 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 652ade1f8470ca94c969d73a150c5cd3 columnFamilyName f1 2023-02-17 18:02:00,641 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(310): Store=652ade1f8470ca94c969d73a150c5cd3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:02:00,641 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,642 DEBUG [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2 2023-02-17 18:02:00,642 DEBUG [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2 2023-02-17 18:02:00,642 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 652ade1f8470ca94c969d73a150c5cd3 columnFamilyName f2 2023-02-17 18:02:00,642 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(310): Store=652ade1f8470ca94c969d73a150c5cd3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:02:00,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:02:00,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:00,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-17 18:02:00,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 652ade1f8470ca94c969d73a150c5cd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64316897, jitterRate=-0.04160355031490326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:02:00,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 652ade1f8470ca94c969d73a150c5cd3: 2023-02-17 18:02:00,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3., pid=12, masterSystemTime=1676656920635 2023-02-17 18:02:00,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:00,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:00,649 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=652ade1f8470ca94c969d73a150c5cd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:00,649 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676656920649"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676656920649"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676656920649"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676656920649"}]},"ts":"1676656920649"} 2023-02-17 18:02:00,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-17 18:02:00,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 652ade1f8470ca94c969d73a150c5cd3, server=jenkins-hbase4.apache.org,45345,1676656919047 in 167 msec 2023-02-17 18:02:00,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-17 18:02:00,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=652ade1f8470ca94c969d73a150c5cd3, ASSIGN in 322 msec 2023-02-17 18:02:00,654 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-17 18:02:00,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656920654"}]},"ts":"1676656920654"} 2023-02-17 18:02:00,655 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-17 18:02:00,657 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-17 18:02:00,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 353 msec 2023-02-17 18:02:00,858 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-17 18:02:00,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-17 18:02:00,911 INFO [Listener at localhost/38259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-17 18:02:00,912 DEBUG [Listener at localhost/38259] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-17 18:02:00,912 INFO [Listener at localhost/38259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:02:00,919 INFO [Listener at localhost/38259] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-17 18:02:00,920 INFO [Listener at localhost/38259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-17 18:02:00,920 INFO [Listener at localhost/38259] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-17 18:02:00,920 INFO [Listener at localhost/38259] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-17 18:02:00,984 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45345] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,088 INFO [Listener at localhost/38259] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-17 18:02:01,088 INFO [Listener at localhost/38259] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-17 18:02:01,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 18:02:01,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676656921089 (current time:1676656921089). 2023-02-17 18:02:01,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-17 18:02:01,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] zookeeper.ReadOnlyZKClient(139): Connect 0x051ddd1b to 127.0.0.1:52396 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-17 18:02:01,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f687fdf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-17 18:02:01,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-17 18:02:01,095 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58108, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-17 18:02:01,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x051ddd1b to 127.0.0.1:52396 2023-02-17 18:02:01,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:02:01,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-17 18:02:01,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 18:02:01,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 18:02:01,099 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 18:02:01,100 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676657521100 2023-02-17 18:02:01,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-17 18:02:01,100 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-17 18:02:01,101 DEBUG [Listener at localhost/38259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-17 18:02:01,101 DEBUG [Listener at localhost/38259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-17 18:02:01,102 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-17 18:02:01,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 18:02:01,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-17 18:02:01,103 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 18:02:01,104 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676657521104 2023-02-17 18:02:01,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-17 18:02:01,113 INFO [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-17 18:02:01,113 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:02:01,114 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-17 18:02:01,114 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-17 18:02:01,115 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,115 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 18:02:01,116 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:02:01,116 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:02:01,116 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:02:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:02:01,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:02:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:02:01,116 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,116 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:02:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 18:02:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 18:02:01,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-17 18:02:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 18:02:01,117 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-17 18:02:01,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-17 18:02:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-17 18:02:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 18:02:01,118 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-17 18:02:01,118 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-17 18:02:01,118 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:02:01,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-17 18:02:01,119 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 18:02:01,119 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-17 18:02:01,119 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45345,1676656919047' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-17 18:02:01,119 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-17 18:02:01,119 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-17 18:02:01,121 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-17 18:02:01,121 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-17 18:02:01,121 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46487,1676656919017' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-17 18:02:01,123 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,123 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:02:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:02:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:02:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:02:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:02:01,124 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:02:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 18:02:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:02:01,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45345,1676656919047' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-17 18:02:01,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43d8b8b4[Count = 0] remaining members to acquire global barrier 2023-02-17 18:02:01,126 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-17 18:02:01,126 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,127 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,127 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,127 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 18:02:01,127 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-17 18:02:01,127 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-17 18:02:01,127 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,127 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:02:01,127 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,46487,1676656919017' in zk 2023-02-17 18:02:01,127 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-17 18:02:01,127 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-17 18:02:01,127 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,128 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. started... 2023-02-17 18:02:01,128 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 652ade1f8470ca94c969d73a150c5cd3 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-17 18:02:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-17 18:02:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:02:01,129 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-17 18:02:01,143 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/.tmp/f1/41ff7094994e438fb79629d2f43b7782 2023-02-17 18:02:01,159 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/.tmp/f2/aeec0a4a1a7d448ba9e770cbd480cb18 2023-02-17 18:02:01,163 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/.tmp/f1/41ff7094994e438fb79629d2f43b7782 as hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/41ff7094994e438fb79629d2f43b7782 2023-02-17 18:02:01,166 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/41ff7094994e438fb79629d2f43b7782, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 18:02:01,167 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/.tmp/f2/aeec0a4a1a7d448ba9e770cbd480cb18 as hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/aeec0a4a1a7d448ba9e770cbd480cb18 2023-02-17 18:02:01,170 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/aeec0a4a1a7d448ba9e770cbd480cb18, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-17 18:02:01,171 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 652ade1f8470ca94c969d73a150c5cd3 in 43ms, sequenceid=5, compaction requested=false 2023-02-17 18:02:01,171 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 652ade1f8470ca94c969d73a150c5cd3: 2023-02-17 18:02:01,171 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-17 18:02:01,171 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-17 18:02:01,171 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/41ff7094994e438fb79629d2f43b7782] hfiles 2023-02-17 18:02:01,171 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/41ff7094994e438fb79629d2f43b7782 for snapshot=testWithMapReduceSingleRegion 2023-02-17 18:02:01,171 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/aeec0a4a1a7d448ba9e770cbd480cb18] hfiles 2023-02-17 18:02:01,171 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/aeec0a4a1a7d448ba9e770cbd480cb18 for snapshot=testWithMapReduceSingleRegion 2023-02-17 18:02:01,176 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. completed. 2023-02-17 18:02:01,176 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,177 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-17 18:02:01,177 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-17 18:02:01,177 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,177 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-17 18:02:01,177 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45345,1676656919047' in zk 2023-02-17 18:02:01,180 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,180 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-17 18:02:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,180 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:02:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:02:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:02:01,180 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-17 18:02:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:02:01,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:02:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 18:02:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:02:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 18:02:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,45345,1676656919047': 2023-02-17 18:02:01,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45345,1676656919047' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-17 18:02:01,182 INFO [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-17 18:02:01,183 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:02:01,183 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:02:01,183 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-17 18:02:01,183 INFO [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-17 18:02:01,184 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,184 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:02:01,184 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-17 18:02:01,184 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:02:01,184 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:02:01,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:02:01,185 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:02:01,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:02:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:02:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:02:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 18:02:01,185 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:02:01,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 18:02:01,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,186 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:02:01,187 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-17 18:02:01,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,192 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:02:01,192 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:02:01,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:02:01,192 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-17 18:02:01,192 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:02:01,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-17 18:02:01,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:02:01,192 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-17 18:02:01,192 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-17 18:02:01,192 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 18:02:01,192 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,193 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-17 18:02:01,193 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,193 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,193 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,193 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-17 18:02:01,193 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-17 18:02:01,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-17 18:02:01,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-17 18:02:01,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-17 18:02:01,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:02:01,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:02:01,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-17 18:02:01,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-17 18:02:01,201 DEBUG [Listener at localhost/38259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:02:01,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:02:01,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-17 18:02:01,203 DEBUG [Listener at localhost/38259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-17 18:02:01,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-17 18:02:01,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-17 18:02:01,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-17 18:02:01,223 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-17 18:02:01,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676656921100Consolidate snapshot: testWithMapReduceSingleRegion at 1676656921192 (+92 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676656921192Writing data manifest for testWithMapReduceSingleRegion at 1676656921195 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676656921204 (+9 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676656921222 (+18 ms) 2023-02-17 18:02:01,226 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-17 18:02:01,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 125 msec 2023-02-17 18:02:01,403 DEBUG [Listener at localhost/38259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-17 18:02:01,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-17 18:02:01,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-17 18:02:01,405 INFO [Listener at localhost/38259] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-17 18:02:01,409 INFO [Listener at localhost/38259] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-17 18:02:01,415 INFO [Listener at localhost/38259] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-17 18:02:01,446 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45345] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,536 INFO [Listener at localhost/38259] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-17 18:02:01,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-17 18:02:01,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-17 18:02:01,542 INFO [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-17 18:02:01,542 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:02:01,542 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-17 18:02:01,542 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-17 18:02:01,542 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,542 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:02:01,545 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:02:01,545 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:02:01,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:02:01,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:02:01,545 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:02:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:02:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:02:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:02:01,545 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,545 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-17 18:02:01,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:02:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:02:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-17 18:02:01,546 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 18:02:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:02:01,546 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-17 18:02:01,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 18:02:01,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46487,1676656919017' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-17 18:02:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-17 18:02:01,548 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,548 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. started... 2023-02-17 18:02:01,549 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 652ade1f8470ca94c969d73a150c5cd3 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-17 18:02:01,550 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,550 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,550 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:02:01,563 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/.tmp/f1/cd131b63e03d4e9785ebb58912256290 2023-02-17 18:02:01,585 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/.tmp/f2/5fcaebc178204fd9be0f39105dc6eedb 2023-02-17 18:02:01,590 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/.tmp/f1/cd131b63e03d4e9785ebb58912256290 as hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/cd131b63e03d4e9785ebb58912256290 2023-02-17 18:02:01,593 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/cd131b63e03d4e9785ebb58912256290, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 18:02:01,594 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/.tmp/f2/5fcaebc178204fd9be0f39105dc6eedb as hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/5fcaebc178204fd9be0f39105dc6eedb 2023-02-17 18:02:01,598 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/5fcaebc178204fd9be0f39105dc6eedb, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-17 18:02:01,599 INFO [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 652ade1f8470ca94c969d73a150c5cd3 in 50ms, sequenceid=9, compaction requested=false 2023-02-17 18:02:01,599 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 652ade1f8470ca94c969d73a150c5cd3: 2023-02-17 18:02:01,599 DEBUG [rs(jenkins-hbase4.apache.org,45345,1676656919047)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,599 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-17 18:02:01,599 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-17 18:02:01,599 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,599 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-17 18:02:01,599 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45345,1676656919047' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-17 18:02:01,600 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,601 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:02:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:02:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:02:01,601 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,601 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-17 18:02:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:02:01,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:02:01,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:02:01,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45345,1676656919047' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-17 18:02:01,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47e72417[Count = 0] remaining members to acquire global barrier 2023-02-17 18:02:01,603 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-17 18:02:01,603 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,604 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,604 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,604 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 18:02:01,604 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-17 18:02:01,604 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 18:02:01,604 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,604 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-17 18:02:01,604 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-17 18:02:01,604 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45345,1676656919047' in zk 2023-02-17 18:02:01,604 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46487,1676656919017' in zk 2023-02-17 18:02:01,607 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 18:02:01,607 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,607 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-17 18:02:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,607 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:02:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:02:01,607 DEBUG [member: 'jenkins-hbase4.apache.org,46487,1676656919017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 18:02:01,607 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:02:01,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:02:01,607 DEBUG [member: 'jenkins-hbase4.apache.org,45345,1676656919047' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-17 18:02:01,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:02:01,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:02:01,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:02:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:02:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:02:01,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45345,1676656919047': 2023-02-17 18:02:01,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45345,1676656919047' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-17 18:02:01,610 INFO [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-17 18:02:01,610 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-17 18:02:01,610 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-17 18:02:01,610 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-17 18:02:01,610 INFO [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-17 18:02:01,612 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,612 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,612 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-17 18:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-17 18:02:01,612 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,612 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:02:01,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,612 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:02:01,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:02:01,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-17 18:02:01,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,613 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:02:01,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-17 18:02:01,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:02:01,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,614 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-17 18:02:01,615 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-17 18:02:01,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,617 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,617 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:02:01,617 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:02:01,617 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,617 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-17 18:02:01,617 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:02:01,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:02:01,618 DEBUG [(jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-17 18:02:01,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-17 18:02:01,617 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-17 18:02:01,617 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-17 18:02:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:02:01,618 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:01,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-17 18:02:01,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-17 18:02:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-17 18:02:01,618 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,618 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:01,618 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-17 18:02:01,618 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-17 18:02:01,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:02:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:02:01,618 DEBUG [Listener at localhost/38259] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-17 18:02:01,618 DEBUG [Listener at localhost/38259] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-17 18:02:01,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-17 18:02:01,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-17 18:02:01,718 DEBUG [Listener at localhost/38259] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-17 18:02:01,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-17 18:02:01,808 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/hadoop-7601947852571059983.jar 2023-02-17 18:02:01,812 INFO [Listener at localhost/38259] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676656921089 type: FLUSH version: 2 ttl: 0 2023-02-17 18:02:01,813 DEBUG [Listener at localhost/38259] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45441/user/jenkins/test-data/ca0f5805-e9a6-57f4-3f33-f09613c56d59/testWithMapReduceSingleRegion/65a16280-769e-4156-bb90-0e42513269d6/data/default/testWithMapReduce 2023-02-17 18:02:01,813 INFO [Listener at localhost/38259] snapshot.RestoreSnapshotHelper(239): region to add: 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:01,813 INFO [Listener at localhost/38259] snapshot.RestoreSnapshotHelper(585): clone region=652ade1f8470ca94c969d73a150c5cd3 as 652ade1f8470ca94c969d73a150c5cd3 in snapshot testWithMapReduceSingleRegion 2023-02-17 18:02:01,814 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 652ade1f8470ca94c969d73a150c5cd3, NAME => 'testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/ca0f5805-e9a6-57f4-3f33-f09613c56d59/testWithMapReduceSingleRegion/65a16280-769e-4156-bb90-0e42513269d6 2023-02-17 18:02:01,831 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:02:01,831 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 41ff7094994e438fb79629d2f43b7782 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-17 18:02:01,833 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aeec0a4a1a7d448ba9e770cbd480cb18 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-17 18:02:01,834 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 652ade1f8470ca94c969d73a150c5cd3, disabling compactions & flushes 2023-02-17 18:02:01,835 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,835 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,835 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. after waiting 0 ms 2023-02-17 18:02:01,835 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,835 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:01,835 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 652ade1f8470ca94c969d73a150c5cd3: 2023-02-17 18:02:01,835 INFO [Listener at localhost/38259] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676656921089 type: FLUSH version: 2 ttl: 0 2023-02-17 18:02:01,835 DEBUG [Listener at localhost/38259] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45441/user/jenkins/test-data/ca0f5805-e9a6-57f4-3f33-f09613c56d59/testWithMapReduceSingleRegion/65a16280-769e-4156-bb90-0e42513269d6 2023-02-17 18:02:01,835 DEBUG [Listener at localhost/38259] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45441/user/jenkins/test-data/ca0f5805-e9a6-57f4-3f33-f09613c56d59/testWithMapReduceSingleRegion/65a16280-769e-4156-bb90-0e42513269d6 2023-02-17 18:02:01,835 DEBUG [Listener at localhost/38259] util.CommonFSUtils(699): |-data/ 2023-02-17 18:02:01,836 DEBUG [Listener at localhost/38259] util.CommonFSUtils(699): |----default/ 2023-02-17 18:02:01,836 DEBUG [Listener at localhost/38259] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-17 18:02:01,837 DEBUG [Listener at localhost/38259] util.CommonFSUtils(699): |----------652ade1f8470ca94c969d73a150c5cd3/ 2023-02-17 18:02:01,837 DEBUG [Listener at localhost/38259] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-17 18:02:01,837 DEBUG [Listener at localhost/38259] util.CommonFSUtils(699): |-------------f1/ 2023-02-17 18:02:01,838 DEBUG [Listener at localhost/38259] util.CommonFSUtils(702): |----------------testWithMapReduce=652ade1f8470ca94c969d73a150c5cd3-41ff7094994e438fb79629d2f43b7782 2023-02-17 18:02:01,838 DEBUG [Listener at localhost/38259] util.CommonFSUtils(699): |-------------f2/ 2023-02-17 18:02:01,838 DEBUG [Listener at localhost/38259] util.CommonFSUtils(702): |----------------testWithMapReduce=652ade1f8470ca94c969d73a150c5cd3-aeec0a4a1a7d448ba9e770cbd480cb18 2023-02-17 18:02:01,838 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,839 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,839 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,840 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,840 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,841 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,841 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,907 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/hadoop-4180049849324429958.jar 2023-02-17 18:02:01,908 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,908 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,909 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,909 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,909 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,909 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,910 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-17 18:02:01,910 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-17 18:02:01,911 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-17 18:02:01,911 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-17 18:02:01,911 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-17 18:02:01,912 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-17 18:02:01,912 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-17 18:02:01,912 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-17 18:02:01,913 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-17 18:02:01,913 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-17 18:02:01,914 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-17 18:02:01,914 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 18:02:01,914 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 18:02:01,914 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-17 18:02:01,915 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 18:02:01,986 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/hadoop-1406479888527261259.jar 2023-02-17 18:02:01,987 DEBUG [Listener at localhost/38259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-17 18:02:01,992 WARN [Listener at localhost/38259] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-17 18:02:02,021 INFO [Listener at localhost/38259] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-17 18:02:02,101 WARN [Listener at localhost/38259] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/mapreduce.cluster.local.dir/1676656922067/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-17 18:02:02,102 WARN [Listener at localhost/38259] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/mapreduce.cluster.local.dir/1676656922067/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-17 18:02:02,134 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-17 18:02:02,134 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-17 18:02:02,134 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-17 18:02:02,136 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:02,137 DEBUG [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/ca0f5805-e9a6-57f4-3f33-f09613c56d59/testWithMapReduceSingleRegion/65a16280-769e-4156-bb90-0e42513269d6/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1 2023-02-17 18:02:02,137 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 652ade1f8470ca94c969d73a150c5cd3 columnFamilyName f1 2023-02-17 18:02:02,141 DEBUG [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/ca0f5805-e9a6-57f4-3f33-f09613c56d59/testWithMapReduceSingleRegion/65a16280-769e-4156-bb90-0e42513269d6/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/testWithMapReduce=652ade1f8470ca94c969d73a150c5cd3-41ff7094994e438fb79629d2f43b7782 2023-02-17 18:02:02,141 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(310): Store=652ade1f8470ca94c969d73a150c5cd3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:02:02,141 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:02,142 DEBUG [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/ca0f5805-e9a6-57f4-3f33-f09613c56d59/testWithMapReduceSingleRegion/65a16280-769e-4156-bb90-0e42513269d6/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2 2023-02-17 18:02:02,142 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 652ade1f8470ca94c969d73a150c5cd3 columnFamilyName f2 2023-02-17 18:02:02,145 DEBUG [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/ca0f5805-e9a6-57f4-3f33-f09613c56d59/testWithMapReduceSingleRegion/65a16280-769e-4156-bb90-0e42513269d6/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/testWithMapReduce=652ade1f8470ca94c969d73a150c5cd3-aeec0a4a1a7d448ba9e770cbd480cb18 2023-02-17 18:02:02,145 INFO [StoreOpener-652ade1f8470ca94c969d73a150c5cd3-1] regionserver.HStore(310): Store=652ade1f8470ca94c969d73a150c5cd3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-17 18:02:02,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-17 18:02:02,146 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 652ade1f8470ca94c969d73a150c5cd3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62153497, jitterRate=-0.07384072244167328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-17 18:02:02,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 652ade1f8470ca94c969d73a150c5cd3: 2023-02-17 18:02:02,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 652ade1f8470ca94c969d73a150c5cd3, disabling compactions & flushes 2023-02-17 18:02:02,264 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:02,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:02,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. after waiting 0 ms 2023-02-17 18:02:02,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:02,265 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:02,265 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 652ade1f8470ca94c969d73a150c5cd3: 2023-02-17 18:02:03,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-17 18:02:03,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-17 18:02:03,143 INFO [Listener at localhost/38259] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-17 18:02:03,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-17 18:02:03,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-17 18:02:03,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:02:03,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656923146"}]},"ts":"1676656923146"} 2023-02-17 18:02:03,147 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-17 18:02:03,149 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-17 18:02:03,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=652ade1f8470ca94c969d73a150c5cd3, UNASSIGN}] 2023-02-17 18:02:03,150 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=652ade1f8470ca94c969d73a150c5cd3, UNASSIGN 2023-02-17 18:02:03,150 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=652ade1f8470ca94c969d73a150c5cd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:03,151 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676656923150"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676656923150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676656923150"}]},"ts":"1676656923150"} 2023-02-17 18:02:03,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 652ade1f8470ca94c969d73a150c5cd3, server=jenkins-hbase4.apache.org,45345,1676656919047}] 2023-02-17 18:02:03,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:02:03,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:03,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 652ade1f8470ca94c969d73a150c5cd3, disabling compactions & flushes 2023-02-17 18:02:03,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:03,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:03,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. after waiting 0 ms 2023-02-17 18:02:03,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:03,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-17 18:02:03,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3. 2023-02-17 18:02:03,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 652ade1f8470ca94c969d73a150c5cd3: 2023-02-17 18:02:03,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:03,310 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=652ade1f8470ca94c969d73a150c5cd3, regionState=CLOSED 2023-02-17 18:02:03,311 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676656923310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676656923310"}]},"ts":"1676656923310"} 2023-02-17 18:02:03,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-17 18:02:03,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 652ade1f8470ca94c969d73a150c5cd3, server=jenkins-hbase4.apache.org,45345,1676656919047 in 165 msec 2023-02-17 18:02:03,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-17 18:02:03,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=652ade1f8470ca94c969d73a150c5cd3, UNASSIGN in 171 msec 2023-02-17 18:02:03,322 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676656923322"}]},"ts":"1676656923322"} 2023-02-17 18:02:03,323 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-17 18:02:03,325 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-17 18:02:03,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 183 msec 2023-02-17 18:02:03,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-17 18:02:03,449 INFO [Listener at localhost/38259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-17 18:02:03,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-17 18:02:03,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:02:03,452 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:02:03,453 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:02:03,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 18:02:03,456 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:03,458 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/recovered.edits] 2023-02-17 18:02:03,462 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/41ff7094994e438fb79629d2f43b7782 to hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/archive/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/41ff7094994e438fb79629d2f43b7782 2023-02-17 18:02:03,463 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/cd131b63e03d4e9785ebb58912256290 to hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/archive/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f1/cd131b63e03d4e9785ebb58912256290 2023-02-17 18:02:03,466 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/5fcaebc178204fd9be0f39105dc6eedb to hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/archive/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/5fcaebc178204fd9be0f39105dc6eedb 2023-02-17 18:02:03,467 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/aeec0a4a1a7d448ba9e770cbd480cb18 to hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/archive/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/f2/aeec0a4a1a7d448ba9e770cbd480cb18 2023-02-17 18:02:03,469 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/recovered.edits/12.seqid to hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/archive/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3/recovered.edits/12.seqid 2023-02-17 18:02:03,470 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/.tmp/data/default/testWithMapReduce/652ade1f8470ca94c969d73a150c5cd3 2023-02-17 18:02:03,470 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-17 18:02:03,471 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:02:03,473 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-17 18:02:03,474 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-17 18:02:03,475 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:02:03,475 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-17 18:02:03,475 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676656923475"}]},"ts":"9223372036854775807"} 2023-02-17 18:02:03,477 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-17 18:02:03,477 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 652ade1f8470ca94c969d73a150c5cd3, NAME => 'testWithMapReduce,,1676656920304.652ade1f8470ca94c969d73a150c5cd3.', STARTKEY => '', ENDKEY => ''}] 2023-02-17 18:02:03,477 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-17 18:02:03,477 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676656923477"}]},"ts":"9223372036854775807"} 2023-02-17 18:02:03,478 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-17 18:02:03,480 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-17 18:02:03,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 30 msec 2023-02-17 18:02:03,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45011] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-17 18:02:03,555 INFO [Listener at localhost/38259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-17 18:02:03,555 INFO [Listener at localhost/38259] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-17 18:02:03,555 INFO [Listener at localhost/38259] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-17 18:02:03,555 DEBUG [Listener at localhost/38259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07e4b6d0 to 127.0.0.1:52396 2023-02-17 18:02:03,556 DEBUG [Listener at localhost/38259] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:02:03,556 DEBUG [Listener at localhost/38259] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-17 18:02:03,556 DEBUG [Listener at localhost/38259] util.JVMClusterUtil(257): Found active master hash=1182051920, stopped=false 2023-02-17 18:02:03,556 INFO [Listener at localhost/38259] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:02:03,558 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:02:03,558 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:02:03,558 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:02:03,558 INFO [Listener at localhost/38259] procedure2.ProcedureExecutor(629): Stopping 2023-02-17 18:02:03,558 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-17 18:02:03,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:02:03,560 DEBUG [Listener at localhost/38259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66571faf to 127.0.0.1:52396 2023-02-17 18:02:03,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:02:03,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-17 18:02:03,560 DEBUG [Listener at localhost/38259] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:02:03,561 INFO [Listener at localhost/38259] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46487,1676656919017' ***** 2023-02-17 18:02:03,561 INFO [Listener at localhost/38259] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:02:03,561 INFO [Listener at localhost/38259] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45345,1676656919047' ***** 2023-02-17 18:02:03,561 INFO [Listener at localhost/38259] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-17 18:02:03,561 INFO [RS:0;jenkins-hbase4:46487] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:02:03,561 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:02:03,561 INFO [RS:0;jenkins-hbase4:46487] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:02:03,577 INFO [RS:1;jenkins-hbase4:45345] regionserver.HeapMemoryManager(220): Stopping 2023-02-17 18:02:03,577 INFO [RS:0;jenkins-hbase4:46487] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:02:03,577 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-17 18:02:03,577 INFO [RS:1;jenkins-hbase4:45345] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-17 18:02:03,577 INFO [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:03,578 INFO [RS:1;jenkins-hbase4:45345] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-17 18:02:03,578 DEBUG [RS:0;jenkins-hbase4:46487] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ef16fc3 to 127.0.0.1:52396 2023-02-17 18:02:03,578 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(3304): Received CLOSE for 743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:02:03,578 DEBUG [RS:0;jenkins-hbase4:46487] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:02:03,578 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:03,578 DEBUG [RS:1;jenkins-hbase4:45345] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x106db4a3 to 127.0.0.1:52396 2023-02-17 18:02:03,578 DEBUG [RS:1;jenkins-hbase4:45345] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:02:03,578 INFO [RS:1;jenkins-hbase4:45345] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:02:03,578 INFO [RS:1;jenkins-hbase4:45345] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:02:03,578 INFO [RS:1;jenkins-hbase4:45345] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:02:03,578 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-17 18:02:03,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 743bc2b68fcce9eebf257079733cf72d, disabling compactions & flushes 2023-02-17 18:02:03,578 INFO [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46487,1676656919017; all regions closed. 2023-02-17 18:02:03,579 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-17 18:02:03,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:02:03,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-17 18:02:03,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:02:03,579 DEBUG [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1479): Online Regions={743bc2b68fcce9eebf257079733cf72d=hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d., 1588230740=hbase:meta,,1.1588230740} 2023-02-17 18:02:03,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. after waiting 0 ms 2023-02-17 18:02:03,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:02:03,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 743bc2b68fcce9eebf257079733cf72d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-17 18:02:03,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-17 18:02:03,579 DEBUG [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1505): Waiting on 1588230740, 743bc2b68fcce9eebf257079733cf72d 2023-02-17 18:02:03,579 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-17 18:02:03,580 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-17 18:02:03,580 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-17 18:02:03,580 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-17 18:02:03,584 DEBUG [RS:0;jenkins-hbase4:46487] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/oldWALs 2023-02-17 18:02:03,584 INFO [RS:0;jenkins-hbase4:46487] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46487%2C1676656919017:(num 1676656920388) 2023-02-17 18:02:03,584 DEBUG [RS:0;jenkins-hbase4:46487] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:02:03,584 INFO [RS:0;jenkins-hbase4:46487] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:02:03,584 INFO [RS:0;jenkins-hbase4:46487] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-17 18:02:03,584 INFO [RS:0;jenkins-hbase4:46487] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-17 18:02:03,584 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:02:03,584 INFO [RS:0;jenkins-hbase4:46487] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-17 18:02:03,584 INFO [RS:0;jenkins-hbase4:46487] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-17 18:02:03,585 INFO [RS:0;jenkins-hbase4:46487] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46487 2023-02-17 18:02:03,587 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:03,587 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46487,1676656919017 2023-02-17 18:02:03,587 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:02:03,587 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:02:03,587 ERROR [Listener at localhost/38259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ed5cda0 rejected from java.util.concurrent.ThreadPoolExecutor@7aea56a2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:02:03,587 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:02:03,587 ERROR [Listener at localhost/38259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ef58119 rejected from java.util.concurrent.ThreadPoolExecutor@7aea56a2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:02:03,588 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46487,1676656919017] 2023-02-17 18:02:03,588 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46487,1676656919017; numProcessing=1 2023-02-17 18:02:03,590 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46487,1676656919017 already deleted, retry=false 2023-02-17 18:02:03,590 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46487,1676656919017 expired; onlineServers=1 2023-02-17 18:02:03,590 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:02:03,590 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:02:03,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d/.tmp/info/c722693bbcd34e548767b0a243e5d37e 2023-02-17 18:02:03,593 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/.tmp/info/65d49c35c379435a9fc34089abb66561 2023-02-17 18:02:03,597 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65d49c35c379435a9fc34089abb66561 2023-02-17 18:02:03,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d/.tmp/info/c722693bbcd34e548767b0a243e5d37e as hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d/info/c722693bbcd34e548767b0a243e5d37e 2023-02-17 18:02:03,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d/info/c722693bbcd34e548767b0a243e5d37e, entries=2, sequenceid=6, filesize=4.8 K 2023-02-17 18:02:03,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 743bc2b68fcce9eebf257079733cf72d in 23ms, sequenceid=6, compaction requested=false 2023-02-17 18:02:03,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/.tmp/rep_barrier/7b40afd6211f4baba63fcd6828539dc3 2023-02-17 18:02:03,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/namespace/743bc2b68fcce9eebf257079733cf72d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-17 18:02:03,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:02:03,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 743bc2b68fcce9eebf257079733cf72d: 2023-02-17 18:02:03,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676656919693.743bc2b68fcce9eebf257079733cf72d. 2023-02-17 18:02:03,609 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b40afd6211f4baba63fcd6828539dc3 2023-02-17 18:02:03,617 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/.tmp/table/47a17d60a1054a56b6e91cff8908b7a3 2023-02-17 18:02:03,623 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47a17d60a1054a56b6e91cff8908b7a3 2023-02-17 18:02:03,624 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/.tmp/info/65d49c35c379435a9fc34089abb66561 as hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/info/65d49c35c379435a9fc34089abb66561 2023-02-17 18:02:03,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65d49c35c379435a9fc34089abb66561 2023-02-17 18:02:03,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/info/65d49c35c379435a9fc34089abb66561, entries=12, sequenceid=21, filesize=6.2 K 2023-02-17 18:02:03,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/.tmp/rep_barrier/7b40afd6211f4baba63fcd6828539dc3 as hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/rep_barrier/7b40afd6211f4baba63fcd6828539dc3 2023-02-17 18:02:03,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b40afd6211f4baba63fcd6828539dc3 2023-02-17 18:02:03,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/rep_barrier/7b40afd6211f4baba63fcd6828539dc3, entries=1, sequenceid=21, filesize=5.0 K 2023-02-17 18:02:03,634 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/.tmp/table/47a17d60a1054a56b6e91cff8908b7a3 as hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/table/47a17d60a1054a56b6e91cff8908b7a3 2023-02-17 18:02:03,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47a17d60a1054a56b6e91cff8908b7a3 2023-02-17 18:02:03,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/table/47a17d60a1054a56b6e91cff8908b7a3, entries=4, sequenceid=21, filesize=5.0 K 2023-02-17 18:02:03,638 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 58ms, sequenceid=21, compaction requested=false 2023-02-17 18:02:03,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-17 18:02:03,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-17 18:02:03,645 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-17 18:02:03,645 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-17 18:02:03,645 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-17 18:02:03,758 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:02:03,758 INFO [RS:0;jenkins-hbase4:46487] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46487,1676656919017; zookeeper connection closed. 2023-02-17 18:02:03,758 ERROR [Listener at localhost/38259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26eae78d rejected from java.util.concurrent.ThreadPoolExecutor@7aea56a2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:02:03,758 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:46487-0x10063722b720001, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:02:03,758 ERROR [Listener at localhost/38259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2dc8877c rejected from java.util.concurrent.ThreadPoolExecutor@7aea56a2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:02:03,758 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f8cc4a6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f8cc4a6 2023-02-17 18:02:03,780 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45345,1676656919047; all regions closed. 2023-02-17 18:02:03,785 DEBUG [RS:1;jenkins-hbase4:45345] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/oldWALs 2023-02-17 18:02:03,785 INFO [RS:1;jenkins-hbase4:45345] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45345%2C1676656919047.meta:.meta(num 1676656919594) 2023-02-17 18:02:03,788 DEBUG [RS:1;jenkins-hbase4:45345] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/oldWALs 2023-02-17 18:02:03,788 INFO [RS:1;jenkins-hbase4:45345] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45345%2C1676656919047:(num 1676656920083) 2023-02-17 18:02:03,788 DEBUG [RS:1;jenkins-hbase4:45345] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:02:03,789 INFO [RS:1;jenkins-hbase4:45345] regionserver.LeaseManager(133): Closed leases 2023-02-17 18:02:03,789 INFO [RS:1;jenkins-hbase4:45345] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-17 18:02:03,789 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:02:03,792 INFO [RS:1;jenkins-hbase4:45345] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45345 2023-02-17 18:02:03,794 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45345,1676656919047 2023-02-17 18:02:03,794 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-17 18:02:03,795 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45345,1676656919047] 2023-02-17 18:02:03,795 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45345,1676656919047; numProcessing=2 2023-02-17 18:02:03,797 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45345,1676656919047 already deleted, retry=false 2023-02-17 18:02:03,797 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45345,1676656919047 expired; onlineServers=0 2023-02-17 18:02:03,797 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45011,1676656918975' ***** 2023-02-17 18:02:03,797 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-17 18:02:03,798 DEBUG [M:0;jenkins-hbase4:45011] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@424b2246, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-17 18:02:03,798 INFO [M:0;jenkins-hbase4:45011] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45011,1676656918975 2023-02-17 18:02:03,798 INFO [M:0;jenkins-hbase4:45011] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45011,1676656918975; all regions closed. 2023-02-17 18:02:03,798 DEBUG [M:0;jenkins-hbase4:45011] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-17 18:02:03,798 DEBUG [M:0;jenkins-hbase4:45011] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-17 18:02:03,798 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-17 18:02:03,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656919240] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676656919240,5,FailOnTimeoutGroup] 2023-02-17 18:02:03,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656919240] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676656919240,5,FailOnTimeoutGroup] 2023-02-17 18:02:03,798 DEBUG [M:0;jenkins-hbase4:45011] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-17 18:02:03,800 INFO [M:0;jenkins-hbase4:45011] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-17 18:02:03,800 INFO [M:0;jenkins-hbase4:45011] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-17 18:02:03,800 INFO [M:0;jenkins-hbase4:45011] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-17 18:02:03,800 DEBUG [M:0;jenkins-hbase4:45011] master.HMaster(1512): Stopping service threads 2023-02-17 18:02:03,800 INFO [M:0;jenkins-hbase4:45011] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-17 18:02:03,801 ERROR [M:0;jenkins-hbase4:45011] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-17 18:02:03,801 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-17 18:02:03,801 INFO [M:0;jenkins-hbase4:45011] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-17 18:02:03,801 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-17 18:02:03,801 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-17 18:02:03,801 DEBUG [M:0;jenkins-hbase4:45011] zookeeper.ZKUtil(398): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-17 18:02:03,801 WARN [M:0;jenkins-hbase4:45011] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-17 18:02:03,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-17 18:02:03,801 INFO [M:0;jenkins-hbase4:45011] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-17 18:02:03,802 INFO [M:0;jenkins-hbase4:45011] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-17 18:02:03,802 DEBUG [M:0;jenkins-hbase4:45011] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-17 18:02:03,802 INFO [M:0;jenkins-hbase4:45011] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:02:03,802 DEBUG [M:0;jenkins-hbase4:45011] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:02:03,802 DEBUG [M:0;jenkins-hbase4:45011] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-17 18:02:03,802 DEBUG [M:0;jenkins-hbase4:45011] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:02:03,802 INFO [M:0;jenkins-hbase4:45011] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.67 KB heapSize=65.64 KB 2023-02-17 18:02:03,812 INFO [M:0;jenkins-hbase4:45011] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f909b33e29774dc8a207548c0562dc75 2023-02-17 18:02:03,817 DEBUG [M:0;jenkins-hbase4:45011] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f909b33e29774dc8a207548c0562dc75 as hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f909b33e29774dc8a207548c0562dc75 2023-02-17 18:02:03,820 INFO [M:0;jenkins-hbase4:45011] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/4ca4b756-5ed9-516e-d755-310bd91a88d8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f909b33e29774dc8a207548c0562dc75, entries=17, sequenceid=132, filesize=8.6 K 2023-02-17 18:02:03,821 INFO [M:0;jenkins-hbase4:45011] regionserver.HRegion(2947): Finished flush of dataSize ~54.67 KB/55983, heapSize ~65.63 KB/67200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-17 18:02:03,822 INFO [M:0;jenkins-hbase4:45011] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-17 18:02:03,822 DEBUG [M:0;jenkins-hbase4:45011] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-17 18:02:03,824 INFO [M:0;jenkins-hbase4:45011] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-17 18:02:03,824 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-17 18:02:03,824 INFO [M:0;jenkins-hbase4:45011] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45011 2023-02-17 18:02:03,831 DEBUG [M:0;jenkins-hbase4:45011] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45011,1676656918975 already deleted, retry=false 2023-02-17 18:02:04,159 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:02:04,159 INFO [M:0;jenkins-hbase4:45011] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45011,1676656918975; zookeeper connection closed. 2023-02-17 18:02:04,159 ERROR [Listener at localhost/38259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7eb6ae0 rejected from java.util.concurrent.ThreadPoolExecutor@3d4eec5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:02:04,161 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): master:45011-0x10063722b720000, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:02:04,161 ERROR [Listener at localhost/38259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b3a4499 rejected from java.util.concurrent.ThreadPoolExecutor@3d4eec5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:02:04,259 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:02:04,260 INFO [RS:1;jenkins-hbase4:45345] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45345,1676656919047; zookeeper connection closed. 2023-02-17 18:02:04,260 ERROR [Listener at localhost/38259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@dab589c rejected from java.util.concurrent.ThreadPoolExecutor@994ddf1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:02:04,260 DEBUG [Listener at localhost/38259-EventThread] zookeeper.ZKWatcher(600): regionserver:45345-0x10063722b720002, quorum=127.0.0.1:52396, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-17 18:02:04,260 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@72b2d9e6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@72b2d9e6 2023-02-17 18:02:04,260 ERROR [Listener at localhost/38259-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2aa83d0a rejected from java.util.concurrent.ThreadPoolExecutor@994ddf1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-17 18:02:04,260 INFO [Listener at localhost/38259] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-17 18:02:04,260 WARN [Listener at localhost/38259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:02:04,265 INFO [Listener at localhost/38259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:02:04,268 WARN [BP-1449357399-172.31.14.131-1676656918352 heartbeating to localhost/127.0.0.1:45441] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:02:04,268 WARN [BP-1449357399-172.31.14.131-1676656918352 heartbeating to localhost/127.0.0.1:45441] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1449357399-172.31.14.131-1676656918352 (Datanode Uuid 540c498d-1741-499c-a617-b46b1c2f4072) service to localhost/127.0.0.1:45441 2023-02-17 18:02:04,269 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/cluster_e778fa98-b067-be94-e173-932f7969e2f4/dfs/data/data3/current/BP-1449357399-172.31.14.131-1676656918352] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:02:04,269 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/cluster_e778fa98-b067-be94-e173-932f7969e2f4/dfs/data/data4/current/BP-1449357399-172.31.14.131-1676656918352] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:02:04,271 WARN [Listener at localhost/38259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-17 18:02:04,277 INFO [Listener at localhost/38259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:02:04,378 WARN [BP-1449357399-172.31.14.131-1676656918352 heartbeating to localhost/127.0.0.1:45441] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-17 18:02:04,379 WARN [BP-1449357399-172.31.14.131-1676656918352 heartbeating to localhost/127.0.0.1:45441] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1449357399-172.31.14.131-1676656918352 (Datanode Uuid f0778ec0-033a-4d91-9f6a-ce59d1ed9b3f) service to localhost/127.0.0.1:45441 2023-02-17 18:02:04,379 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/cluster_e778fa98-b067-be94-e173-932f7969e2f4/dfs/data/data1/current/BP-1449357399-172.31.14.131-1676656918352] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:02:04,380 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cfb2097e-e005-9a82-9e27-aa348e044403/cluster_e778fa98-b067-be94-e173-932f7969e2f4/dfs/data/data2/current/BP-1449357399-172.31.14.131-1676656918352] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-17 18:02:04,392 INFO [Listener at localhost/38259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-17 18:02:04,506 INFO [Listener at localhost/38259] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-17 18:02:04,531 INFO [Listener at localhost/38259] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-17 18:02:04,544 INFO [Listener at localhost/38259] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=294 (was 275) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45441 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:45441 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:45441 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:45441 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:45441 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1185813668) connection to localhost/127.0.0.1:45441 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38259 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45011,1676656918975)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:45441 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=601 (was 570) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 322), ProcessCount=170 (was 170), AvailableMemoryMB=8019 (was 6946) - AvailableMemoryMB LEAK? -