2023-02-12 12:02:55,485 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-12 12:02:55,534 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=221, ProcessCount=165, AvailableMemoryMB=5464 2023-02-12 12:02:55,802 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c 2023-02-12 12:02:55,809 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 12:02:55,809 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/cluster_a4f83f0c-559c-314d-330e-0afac50f89a6, deleteOnExit=true 2023-02-12 12:02:55,810 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 12:02:55,810 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/test.cache.data in system properties and HBase conf 2023-02-12 12:02:55,810 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 12:02:55,811 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/hadoop.log.dir in system properties and HBase conf 2023-02-12 12:02:55,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 12:02:55,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 12:02:55,812 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 12:02:55,911 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-12 12:02:56,273 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 12:02:56,277 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:02:56,278 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:02:56,278 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 12:02:56,279 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:02:56,279 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 12:02:56,279 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 12:02:56,279 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:02:56,280 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:02:56,280 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 12:02:56,281 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/nfs.dump.dir in system properties and HBase conf 2023-02-12 12:02:56,281 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/java.io.tmpdir in system properties and HBase conf 2023-02-12 12:02:56,282 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:02:56,282 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 12:02:56,282 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 12:02:56,777 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:02:56,783 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:02:57,067 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-12 12:02:57,222 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-12 12:02:57,235 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:02:57,268 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:02:57,300 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/java.io.tmpdir/Jetty_localhost_43961_hdfs____i84ry7/webapp 2023-02-12 12:02:57,435 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43961 2023-02-12 12:02:57,446 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:02:57,447 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:02:57,953 WARN [Listener at localhost/41375] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:02:58,039 WARN [Listener at localhost/41375] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:02:58,062 WARN [Listener at localhost/41375] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:02:58,068 INFO [Listener at localhost/41375] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:02:58,086 INFO [Listener at localhost/41375] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/java.io.tmpdir/Jetty_localhost_42393_datanode____.ir8p56/webapp 2023-02-12 12:02:58,209 INFO [Listener at localhost/41375] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42393 2023-02-12 12:02:58,688 WARN [Listener at localhost/37469] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:02:58,742 WARN [Listener at localhost/37469] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:02:58,748 WARN [Listener at localhost/37469] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:02:58,750 INFO [Listener at localhost/37469] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:02:58,756 INFO [Listener at localhost/37469] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/java.io.tmpdir/Jetty_localhost_35589_datanode____xo9tff/webapp 2023-02-12 12:02:58,881 INFO [Listener at localhost/37469] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35589 2023-02-12 12:02:58,896 WARN [Listener at localhost/35477] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:02:59,215 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xef17ee1ab208a5f0: Processing first storage report for DS-e08c213c-ec1a-461f-9262-1dc39eb71aba from datanode 63615642-4b52-485e-a40b-8831830dcef4 2023-02-12 12:02:59,217 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xef17ee1ab208a5f0: from storage DS-e08c213c-ec1a-461f-9262-1dc39eb71aba node DatanodeRegistration(127.0.0.1:45111, datanodeUuid=63615642-4b52-485e-a40b-8831830dcef4, infoPort=34663, infoSecurePort=0, ipcPort=37469, storageInfo=lv=-57;cid=testClusterID;nsid=1843980481;c=1676203376864), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-12 12:02:59,218 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x49ef9f865f5410f4: Processing first storage report for DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e from datanode b30672b0-0228-4732-8b5e-afb56536b11e 2023-02-12 12:02:59,218 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x49ef9f865f5410f4: from storage DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e node DatanodeRegistration(127.0.0.1:45959, datanodeUuid=b30672b0-0228-4732-8b5e-afb56536b11e, infoPort=46307, infoSecurePort=0, ipcPort=35477, storageInfo=lv=-57;cid=testClusterID;nsid=1843980481;c=1676203376864), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 12:02:59,218 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xef17ee1ab208a5f0: Processing first storage report for DS-76f8a927-74d0-4fda-b337-b95148b97dcc from datanode 63615642-4b52-485e-a40b-8831830dcef4 2023-02-12 12:02:59,218 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xef17ee1ab208a5f0: from storage DS-76f8a927-74d0-4fda-b337-b95148b97dcc node DatanodeRegistration(127.0.0.1:45111, datanodeUuid=63615642-4b52-485e-a40b-8831830dcef4, infoPort=34663, infoSecurePort=0, ipcPort=37469, storageInfo=lv=-57;cid=testClusterID;nsid=1843980481;c=1676203376864), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:02:59,218 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x49ef9f865f5410f4: Processing first storage report for DS-a34f4d11-5a04-4089-b364-7796a7e48d7e from datanode b30672b0-0228-4732-8b5e-afb56536b11e 2023-02-12 12:02:59,219 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x49ef9f865f5410f4: from storage DS-a34f4d11-5a04-4089-b364-7796a7e48d7e node DatanodeRegistration(127.0.0.1:45959, datanodeUuid=b30672b0-0228-4732-8b5e-afb56536b11e, infoPort=46307, infoSecurePort=0, ipcPort=35477, storageInfo=lv=-57;cid=testClusterID;nsid=1843980481;c=1676203376864), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:02:59,331 DEBUG [Listener at localhost/35477] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c 2023-02-12 12:02:59,425 INFO [Listener at localhost/35477] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/cluster_a4f83f0c-559c-314d-330e-0afac50f89a6/zookeeper_0, clientPort=59386, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/cluster_a4f83f0c-559c-314d-330e-0afac50f89a6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/cluster_a4f83f0c-559c-314d-330e-0afac50f89a6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 12:02:59,444 INFO [Listener at localhost/35477] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59386 2023-02-12 12:02:59,452 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:02:59,455 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:00,154 INFO [Listener at localhost/35477] util.FSUtils(479): Created version file at hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9 with version=8 2023-02-12 12:03:00,155 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:00,156 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:00,159 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/hbase-staging 2023-02-12 12:03:00,479 INFO [Listener at localhost/35477] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-12 12:03:01,012 INFO [Listener at localhost/35477] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:01,045 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:01,046 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:01,046 INFO [Listener at localhost/35477] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:01,046 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:01,046 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:01,187 INFO [Listener at localhost/35477] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:01,258 DEBUG [Listener at localhost/35477] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-12 12:03:01,352 INFO [Listener at localhost/35477] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42491 2023-02-12 12:03:01,362 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:01,364 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:01,386 INFO [Listener at localhost/35477] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42491 connecting to ZooKeeper ensemble=127.0.0.1:59386 2023-02-12 12:03:01,431 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:424910x0, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:01,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42491-0x1004869b48c0000 connected 2023-02-12 12:03:01,461 DEBUG [Listener at localhost/35477] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:01,462 DEBUG [Listener at localhost/35477] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:01,466 DEBUG [Listener at localhost/35477] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:01,474 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42491 2023-02-12 12:03:01,474 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42491 2023-02-12 12:03:01,474 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42491 2023-02-12 12:03:01,475 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42491 2023-02-12 12:03:01,475 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42491 2023-02-12 12:03:01,482 INFO [Listener at localhost/35477] master.HMaster(439): hbase.rootdir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9, hbase.cluster.distributed=false 2023-02-12 12:03:01,551 INFO [Listener at localhost/35477] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:01,551 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:01,552 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:01,552 INFO [Listener at localhost/35477] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:01,552 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:01,552 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:01,557 INFO [Listener at localhost/35477] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:01,559 INFO [Listener at localhost/35477] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38721 2023-02-12 12:03:01,562 INFO [Listener at localhost/35477] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:01,569 DEBUG [Listener at localhost/35477] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:01,570 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:01,572 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:01,574 INFO [Listener at localhost/35477] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38721 connecting to ZooKeeper ensemble=127.0.0.1:59386 2023-02-12 12:03:01,577 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:387210x0, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:01,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38721-0x1004869b48c0001 connected 2023-02-12 12:03:01,579 DEBUG [Listener at localhost/35477] zookeeper.ZKUtil(164): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:01,580 DEBUG [Listener at localhost/35477] zookeeper.ZKUtil(164): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:01,581 DEBUG [Listener at localhost/35477] zookeeper.ZKUtil(164): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:01,581 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38721 2023-02-12 12:03:01,582 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38721 2023-02-12 12:03:01,584 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38721 2023-02-12 12:03:01,584 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38721 2023-02-12 12:03:01,588 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38721 2023-02-12 12:03:01,601 INFO [Listener at localhost/35477] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:01,601 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:01,601 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:01,601 INFO [Listener at localhost/35477] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:01,602 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:01,602 INFO [Listener at localhost/35477] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:01,602 INFO [Listener at localhost/35477] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:01,603 INFO [Listener at localhost/35477] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44723 2023-02-12 12:03:01,604 INFO [Listener at localhost/35477] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:01,605 DEBUG [Listener at localhost/35477] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:01,606 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:01,609 INFO [Listener at localhost/35477] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:01,612 INFO [Listener at localhost/35477] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44723 connecting to ZooKeeper ensemble=127.0.0.1:59386 2023-02-12 12:03:01,619 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:447230x0, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:01,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44723-0x1004869b48c0002 connected 2023-02-12 12:03:01,620 DEBUG [Listener at localhost/35477] zookeeper.ZKUtil(164): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:01,621 DEBUG [Listener at localhost/35477] zookeeper.ZKUtil(164): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:01,622 DEBUG [Listener at localhost/35477] zookeeper.ZKUtil(164): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:01,622 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44723 2023-02-12 12:03:01,623 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44723 2023-02-12 12:03:01,624 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44723 2023-02-12 12:03:01,628 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44723 2023-02-12 12:03:01,628 DEBUG [Listener at localhost/35477] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44723 2023-02-12 12:03:01,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:01,639 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:01,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:01,662 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:01,662 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:01,662 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:01,662 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:01,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:01,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42491,1676203380318 from backup master directory 2023-02-12 12:03:01,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:01,669 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:01,669 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:01,669 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:01,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:01,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-12 12:03:01,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-12 12:03:01,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/hbase.id with ID: 3369f380-c4eb-4aa7-bd29-54b3434fd636 2023-02-12 12:03:01,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:01,816 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:01,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1770603b to 127.0.0.1:59386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:01,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@420877aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:01,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:01,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 12:03:01,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-12 12:03:01,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-12 12:03:01,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 12:03:01,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 12:03:01,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:01,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/data/master/store-tmp 2023-02-12 12:03:02,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:02,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:02,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:02,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:02,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:02,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:02,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:02,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203382021Disabling compacts and flushes for region at 1676203382022 (+1 ms)Disabling writes for close at 1676203382023 (+1 ms)Writing region close event to WAL at 1676203382023Closed at 1676203382023 2023-02-12 12:03:02,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/WALs/jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:02,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42491%2C1676203380318, suffix=, logDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/WALs/jenkins-hbase4.apache.org,42491,1676203380318, archiveDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/oldWALs, maxLogs=10 2023-02-12 12:03:02,117 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45111,DS-e08c213c-ec1a-461f-9262-1dc39eb71aba,DISK] 2023-02-12 12:03:02,117 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45959,DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e,DISK] 2023-02-12 12:03:02,129 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-12 12:03:02,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/WALs/jenkins-hbase4.apache.org,42491,1676203380318/jenkins-hbase4.apache.org%2C42491%2C1676203380318.1676203382059 2023-02-12 12:03:02,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45111,DS-e08c213c-ec1a-461f-9262-1dc39eb71aba,DISK], DatanodeInfoWithStorage[127.0.0.1:45959,DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e,DISK]] 2023-02-12 12:03:02,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:02,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:02,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:02,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:02,275 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:02,282 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 12:03:02,310 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 12:03:02,325 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:02,331 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:02,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:02,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:02,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:02,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68409418, jitterRate=0.019379764795303345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:02,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676203382241Initializing all the Stores at 1676203382243 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203382243Cleaning up temporary data from old regions at 1676203382339 (+96 ms)Cleaning up detritus from prior splits at 1676203382339Region opened successfully at 1676203382353 (+14 ms) 2023-02-12 12:03:02,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 12:03:02,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 12:03:02,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 12:03:02,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 12:03:02,386 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-12 12:03:02,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-12 12:03:02,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 12:03:02,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 12:03:02,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 12:03:02,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 12:03:02,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 12:03:02,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 12:03:02,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 12:03:02,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 12:03:02,509 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:02,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 12:03:02,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 12:03:02,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 12:03:02,529 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:02,529 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:02,529 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:02,530 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:02,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42491,1676203380318, sessionid=0x1004869b48c0000, setting cluster-up flag (Was=false) 2023-02-12 12:03:02,551 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:02,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 12:03:02,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:02,565 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:02,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 12:03:02,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:02,576 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.hbase-snapshot/.tmp 2023-02-12 12:03:02,633 INFO [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(952): ClusterId : 3369f380-c4eb-4aa7-bd29-54b3434fd636 2023-02-12 12:03:02,633 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(952): ClusterId : 3369f380-c4eb-4aa7-bd29-54b3434fd636 2023-02-12 12:03:02,640 DEBUG [RS:1;jenkins-hbase4:44723] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:02,640 DEBUG [RS:0;jenkins-hbase4:38721] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:02,650 DEBUG [RS:1;jenkins-hbase4:44723] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:02,650 DEBUG [RS:0;jenkins-hbase4:38721] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:02,650 DEBUG [RS:1;jenkins-hbase4:44723] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:02,650 DEBUG [RS:0;jenkins-hbase4:38721] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:02,655 DEBUG [RS:1;jenkins-hbase4:44723] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:02,655 DEBUG [RS:0;jenkins-hbase4:38721] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:02,657 DEBUG [RS:1;jenkins-hbase4:44723] zookeeper.ReadOnlyZKClient(139): Connect 0x763f4acf to 127.0.0.1:59386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:02,658 DEBUG [RS:0;jenkins-hbase4:38721] zookeeper.ReadOnlyZKClient(139): Connect 0x14e56754 to 127.0.0.1:59386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:02,681 DEBUG [RS:1;jenkins-hbase4:44723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f9d5b1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:02,682 DEBUG [RS:0;jenkins-hbase4:38721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b3190b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:02,682 DEBUG [RS:1;jenkins-hbase4:44723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@651cdefa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:02,682 DEBUG [RS:0;jenkins-hbase4:38721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ccf359a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:02,705 DEBUG [RS:0;jenkins-hbase4:38721] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38721 2023-02-12 12:03:02,709 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44723 2023-02-12 12:03:02,710 INFO [RS:0;jenkins-hbase4:38721] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:02,710 INFO [RS:1;jenkins-hbase4:44723] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:02,711 INFO [RS:0;jenkins-hbase4:38721] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:02,711 INFO [RS:1;jenkins-hbase4:44723] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:02,711 DEBUG [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:02,711 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:02,714 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42491,1676203380318 with isa=jenkins-hbase4.apache.org/172.31.14.131:44723, startcode=1676203381600 2023-02-12 12:03:02,714 INFO [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42491,1676203380318 with isa=jenkins-hbase4.apache.org/172.31.14.131:38721, startcode=1676203381550 2023-02-12 12:03:02,733 DEBUG [RS:0;jenkins-hbase4:38721] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:02,733 DEBUG [RS:1;jenkins-hbase4:44723] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:02,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:02,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:02,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:02,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:02,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:02,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 12:03:02,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:02,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676203412759 2023-02-12 12:03:02,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 12:03:02,772 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:02,772 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 12:03:02,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 12:03:02,779 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:02,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 12:03:02,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 12:03:02,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 12:03:02,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 12:03:02,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 12:03:02,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 12:03:02,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 12:03:02,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 12:03:02,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 12:03:02,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203382796,5,FailOnTimeoutGroup] 2023-02-12 12:03:02,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203382796,5,FailOnTimeoutGroup] 2023-02-12 12:03:02,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 12:03:02,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,799 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51105, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:02,799 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46323, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:02,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42491] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:02,814 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:02,826 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:02,827 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:02,827 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9 2023-02-12 12:03:02,836 DEBUG [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9 2023-02-12 12:03:02,836 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9 2023-02-12 12:03:02,837 DEBUG [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41375 2023-02-12 12:03:02,837 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41375 2023-02-12 12:03:02,837 DEBUG [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:02,837 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:02,847 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:02,848 DEBUG [RS:0;jenkins-hbase4:38721] zookeeper.ZKUtil(162): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:02,848 DEBUG [RS:1;jenkins-hbase4:44723] zookeeper.ZKUtil(162): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:02,848 WARN [RS:0;jenkins-hbase4:38721] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:02,852 WARN [RS:1;jenkins-hbase4:44723] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:02,852 INFO [RS:0;jenkins-hbase4:38721] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:02,853 INFO [RS:1;jenkins-hbase4:44723] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:02,853 DEBUG [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/WALs/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:02,853 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/WALs/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:02,853 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38721,1676203381550] 2023-02-12 12:03:02,854 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44723,1676203381600] 2023-02-12 12:03:02,856 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:02,860 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:02,865 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/info 2023-02-12 12:03:02,866 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:02,866 DEBUG [RS:0;jenkins-hbase4:38721] zookeeper.ZKUtil(162): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:02,866 DEBUG [RS:1;jenkins-hbase4:44723] zookeeper.ZKUtil(162): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:02,867 DEBUG [RS:0;jenkins-hbase4:38721] zookeeper.ZKUtil(162): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:02,867 DEBUG [RS:1;jenkins-hbase4:44723] zookeeper.ZKUtil(162): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:02,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:02,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:02,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:02,871 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:02,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:02,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:02,874 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/table 2023-02-12 12:03:02,875 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:02,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:02,878 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740 2023-02-12 12:03:02,879 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740 2023-02-12 12:03:02,880 DEBUG [RS:0;jenkins-hbase4:38721] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:02,880 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:02,884 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:02,887 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:02,891 INFO [RS:0;jenkins-hbase4:38721] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:02,891 INFO [RS:1;jenkins-hbase4:44723] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:02,894 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:02,895 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63439138, jitterRate=-0.054683178663253784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:02,895 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676203382857Initializing all the Stores at 1676203382860 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203382860Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203382860Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203382860Cleaning up temporary data from old regions at 1676203382882 (+22 ms)Cleaning up detritus from prior splits at 1676203382882Region opened successfully at 1676203382895 (+13 ms) 2023-02-12 12:03:02,895 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:02,895 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:02,895 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:02,896 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:02,896 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:02,896 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:02,897 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203382895Disabling compacts and flushes for region at 1676203382895Disabling writes for close at 1676203382896 (+1 ms)Writing region close event to WAL at 1676203382896Closed at 1676203382896 2023-02-12 12:03:02,902 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:02,902 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 12:03:02,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 12:03:02,918 INFO [RS:0;jenkins-hbase4:38721] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:02,918 INFO [RS:1;jenkins-hbase4:44723] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:02,922 INFO [RS:0;jenkins-hbase4:38721] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:02,922 INFO [RS:1;jenkins-hbase4:44723] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:02,923 INFO [RS:0;jenkins-hbase4:38721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,923 INFO [RS:1;jenkins-hbase4:44723] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,924 INFO [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:02,924 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:02,928 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 12:03:02,931 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 12:03:02,934 INFO [RS:1;jenkins-hbase4:44723] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,934 INFO [RS:0;jenkins-hbase4:38721] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,935 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,935 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,935 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,935 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,935 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,935 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,936 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,936 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,936 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,936 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:02,936 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,936 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,936 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:02,936 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,936 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,936 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,937 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,937 DEBUG [RS:1;jenkins-hbase4:44723] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,937 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,937 DEBUG [RS:0;jenkins-hbase4:38721] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:02,938 INFO [RS:1;jenkins-hbase4:44723] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,938 INFO [RS:1;jenkins-hbase4:44723] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,938 INFO [RS:1;jenkins-hbase4:44723] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,938 INFO [RS:0;jenkins-hbase4:38721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,938 INFO [RS:0;jenkins-hbase4:38721] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,939 INFO [RS:0;jenkins-hbase4:38721] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,955 INFO [RS:1;jenkins-hbase4:44723] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:02,955 INFO [RS:0;jenkins-hbase4:38721] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:02,958 INFO [RS:1;jenkins-hbase4:44723] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44723,1676203381600-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,958 INFO [RS:0;jenkins-hbase4:38721] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38721,1676203381550-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:02,976 INFO [RS:1;jenkins-hbase4:44723] regionserver.Replication(203): jenkins-hbase4.apache.org,44723,1676203381600 started 2023-02-12 12:03:02,977 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44723,1676203381600, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44723, sessionid=0x1004869b48c0002 2023-02-12 12:03:02,977 DEBUG [RS:1;jenkins-hbase4:44723] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:02,977 DEBUG [RS:1;jenkins-hbase4:44723] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:02,977 DEBUG [RS:1;jenkins-hbase4:44723] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44723,1676203381600' 2023-02-12 12:03:02,977 DEBUG [RS:1;jenkins-hbase4:44723] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:02,978 DEBUG [RS:1;jenkins-hbase4:44723] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:02,978 DEBUG [RS:1;jenkins-hbase4:44723] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:02,978 INFO [RS:0;jenkins-hbase4:38721] regionserver.Replication(203): jenkins-hbase4.apache.org,38721,1676203381550 started 2023-02-12 12:03:02,978 DEBUG [RS:1;jenkins-hbase4:44723] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:02,978 INFO [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38721,1676203381550, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38721, sessionid=0x1004869b48c0001 2023-02-12 12:03:02,979 DEBUG [RS:1;jenkins-hbase4:44723] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:02,979 DEBUG [RS:0;jenkins-hbase4:38721] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:02,979 DEBUG [RS:1;jenkins-hbase4:44723] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44723,1676203381600' 2023-02-12 12:03:02,979 DEBUG [RS:0;jenkins-hbase4:38721] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:02,979 DEBUG [RS:1;jenkins-hbase4:44723] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:02,980 DEBUG [RS:0;jenkins-hbase4:38721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38721,1676203381550' 2023-02-12 12:03:02,980 DEBUG [RS:0;jenkins-hbase4:38721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:02,980 DEBUG [RS:1;jenkins-hbase4:44723] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:02,980 DEBUG [RS:0;jenkins-hbase4:38721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:02,981 DEBUG [RS:0;jenkins-hbase4:38721] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:02,981 DEBUG [RS:0;jenkins-hbase4:38721] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:02,981 DEBUG [RS:0;jenkins-hbase4:38721] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:02,982 DEBUG [RS:1;jenkins-hbase4:44723] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:02,982 DEBUG [RS:0;jenkins-hbase4:38721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38721,1676203381550' 2023-02-12 12:03:02,982 INFO [RS:1;jenkins-hbase4:44723] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:02,982 DEBUG [RS:0;jenkins-hbase4:38721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:02,982 INFO [RS:1;jenkins-hbase4:44723] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:02,982 DEBUG [RS:0;jenkins-hbase4:38721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:02,983 DEBUG [RS:0;jenkins-hbase4:38721] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:02,983 INFO [RS:0;jenkins-hbase4:38721] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:02,983 INFO [RS:0;jenkins-hbase4:38721] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:03,083 DEBUG [jenkins-hbase4:42491] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 12:03:03,087 DEBUG [jenkins-hbase4:42491] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:03,094 DEBUG [jenkins-hbase4:42491] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:03,094 DEBUG [jenkins-hbase4:42491] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:03,094 DEBUG [jenkins-hbase4:42491] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:03,097 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44723,1676203381600, state=OPENING 2023-02-12 12:03:03,104 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 12:03:03,106 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:03,106 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:03,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:03,297 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:03,300 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:03,303 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59506, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:03,315 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 12:03:03,315 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:03,319 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44723%2C1676203381600.meta, suffix=.meta, logDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/WALs/jenkins-hbase4.apache.org,44723,1676203381600, archiveDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/oldWALs, maxLogs=32 2023-02-12 12:03:03,342 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45959,DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e,DISK] 2023-02-12 12:03:03,342 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45111,DS-e08c213c-ec1a-461f-9262-1dc39eb71aba,DISK] 2023-02-12 12:03:03,349 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/WALs/jenkins-hbase4.apache.org,44723,1676203381600/jenkins-hbase4.apache.org%2C44723%2C1676203381600.meta.1676203383323.meta 2023-02-12 12:03:03,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45959,DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e,DISK], DatanodeInfoWithStorage[127.0.0.1:45111,DS-e08c213c-ec1a-461f-9262-1dc39eb71aba,DISK]] 2023-02-12 12:03:03,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:03,352 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 12:03:03,369 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 12:03:03,374 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 12:03:03,380 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 12:03:03,380 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:03,380 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 12:03:03,380 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 12:03:03,383 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:03,385 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/info 2023-02-12 12:03:03,386 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/info 2023-02-12 12:03:03,386 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:03,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:03,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:03,389 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:03,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:03,390 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:03,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:03,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:03,393 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/table 2023-02-12 12:03:03,393 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/table 2023-02-12 12:03:03,394 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:03,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:03,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740 2023-02-12 12:03:03,400 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740 2023-02-12 12:03:03,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:03,409 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:03,410 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63074820, jitterRate=-0.060111939907073975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:03,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676203383380Writing region info on filesystem at 1676203383381 (+1 ms)Initializing all the Stores at 1676203383382 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203383382Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203383383 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203383383Cleaning up temporary data from old regions at 1676203383402 (+19 ms)Cleaning up detritus from prior splits at 1676203383403 (+1 ms)Running coprocessor post-open hooks at 1676203383411 (+8 ms)Region opened successfully at 1676203383411 2023-02-12 12:03:03,424 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676203383289 2023-02-12 12:03:03,444 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 12:03:03,445 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 12:03:03,446 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44723,1676203381600, state=OPEN 2023-02-12 12:03:03,450 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 12:03:03,450 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:03,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 12:03:03,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44723,1676203381600 in 340 msec 2023-02-12 12:03:03,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 12:03:03,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 542 msec 2023-02-12 12:03:03,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 798 msec 2023-02-12 12:03:03,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676203381655, completionTime=-1 2023-02-12 12:03:03,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 12:03:03,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 12:03:03,531 DEBUG [hconnection-0x7c6dfd24-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:03,534 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58854, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:03,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 12:03:03,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676203443552 2023-02-12 12:03:03,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676203503552 2023-02-12 12:03:03,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 87 msec 2023-02-12 12:03:03,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42491,1676203380318-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:03,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42491,1676203380318-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:03,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42491,1676203380318-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:03,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42491, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:03,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:03,586 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 12:03:03,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 12:03:03,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:03,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 12:03:03,615 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:03,618 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:03,641 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:03,644 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9 empty. 2023-02-12 12:03:03,644 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:03,645 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 12:03:03,679 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:03,681 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 280270a4e0c33d56bfba43ed747050c9, NAME => 'hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:03,698 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:03,699 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 280270a4e0c33d56bfba43ed747050c9, disabling compactions & flushes 2023-02-12 12:03:03,699 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:03,699 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:03,699 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. after waiting 0 ms 2023-02-12 12:03:03,699 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:03,699 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:03,699 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 280270a4e0c33d56bfba43ed747050c9: Waiting for close lock at 1676203383699Disabling compacts and flushes for region at 1676203383699Disabling writes for close at 1676203383699Writing region close event to WAL at 1676203383699Closed at 1676203383699 2023-02-12 12:03:03,703 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:03,718 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203383706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203383706"}]},"ts":"1676203383706"} 2023-02-12 12:03:03,747 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:03,749 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:03,753 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203383749"}]},"ts":"1676203383749"} 2023-02-12 12:03:03,758 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 12:03:03,765 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:03,767 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:03,767 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:03,767 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:03,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=280270a4e0c33d56bfba43ed747050c9, ASSIGN}] 2023-02-12 12:03:03,773 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=280270a4e0c33d56bfba43ed747050c9, ASSIGN 2023-02-12 12:03:03,775 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=280270a4e0c33d56bfba43ed747050c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44723,1676203381600; forceNewPlan=false, retain=false 2023-02-12 12:03:03,927 INFO [jenkins-hbase4:42491] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:03,928 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=280270a4e0c33d56bfba43ed747050c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:03,928 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203383928"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203383928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203383928"}]},"ts":"1676203383928"} 2023-02-12 12:03:03,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 280270a4e0c33d56bfba43ed747050c9, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:03,993 INFO [RS:0;jenkins-hbase4:38721] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38721%2C1676203381550, suffix=, logDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/WALs/jenkins-hbase4.apache.org,38721,1676203381550, archiveDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/oldWALs, maxLogs=32 2023-02-12 12:03:03,993 INFO [RS:1;jenkins-hbase4:44723] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44723%2C1676203381600, suffix=, logDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/WALs/jenkins-hbase4.apache.org,44723,1676203381600, archiveDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/oldWALs, maxLogs=32 2023-02-12 12:03:04,020 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45959,DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e,DISK] 2023-02-12 12:03:04,021 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45111,DS-e08c213c-ec1a-461f-9262-1dc39eb71aba,DISK] 2023-02-12 12:03:04,023 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45959,DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e,DISK] 2023-02-12 12:03:04,023 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45111,DS-e08c213c-ec1a-461f-9262-1dc39eb71aba,DISK] 2023-02-12 12:03:04,029 INFO [RS:0;jenkins-hbase4:38721] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/WALs/jenkins-hbase4.apache.org,38721,1676203381550/jenkins-hbase4.apache.org%2C38721%2C1676203381550.1676203383996 2023-02-12 12:03:04,029 INFO [RS:1;jenkins-hbase4:44723] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/WALs/jenkins-hbase4.apache.org,44723,1676203381600/jenkins-hbase4.apache.org%2C44723%2C1676203381600.1676203383996 2023-02-12 12:03:04,029 DEBUG [RS:0;jenkins-hbase4:38721] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45111,DS-e08c213c-ec1a-461f-9262-1dc39eb71aba,DISK], DatanodeInfoWithStorage[127.0.0.1:45959,DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e,DISK]] 2023-02-12 12:03:04,030 DEBUG [RS:1;jenkins-hbase4:44723] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45959,DS-41f09b4f-cb44-4112-8bbe-73c05e40f00e,DISK], DatanodeInfoWithStorage[127.0.0.1:45111,DS-e08c213c-ec1a-461f-9262-1dc39eb71aba,DISK]] 2023-02-12 12:03:04,096 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:04,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 280270a4e0c33d56bfba43ed747050c9, NAME => 'hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:04,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:04,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:04,098 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:04,100 INFO [StoreOpener-280270a4e0c33d56bfba43ed747050c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:04,103 DEBUG [StoreOpener-280270a4e0c33d56bfba43ed747050c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9/info 2023-02-12 12:03:04,103 DEBUG [StoreOpener-280270a4e0c33d56bfba43ed747050c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9/info 2023-02-12 12:03:04,103 INFO [StoreOpener-280270a4e0c33d56bfba43ed747050c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 280270a4e0c33d56bfba43ed747050c9 columnFamilyName info 2023-02-12 12:03:04,104 INFO [StoreOpener-280270a4e0c33d56bfba43ed747050c9-1] regionserver.HStore(310): Store=280270a4e0c33d56bfba43ed747050c9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:04,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:04,107 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:04,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:04,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:04,118 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 280270a4e0c33d56bfba43ed747050c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62302589, jitterRate=-0.07161907851696014}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:04,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 280270a4e0c33d56bfba43ed747050c9: Running coprocessor pre-open hook at 1676203384098Writing region info on filesystem at 1676203384098Initializing all the Stores at 1676203384099 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203384100 (+1 ms)Cleaning up temporary data from old regions at 1676203384108 (+8 ms)Cleaning up detritus from prior splits at 1676203384109 (+1 ms)Running coprocessor post-open hooks at 1676203384118 (+9 ms)Region opened successfully at 1676203384118 2023-02-12 12:03:04,120 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9., pid=6, masterSystemTime=1676203384089 2023-02-12 12:03:04,125 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:04,125 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:04,127 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=280270a4e0c33d56bfba43ed747050c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:04,127 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203384126"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203384126"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203384126"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203384126"}]},"ts":"1676203384126"} 2023-02-12 12:03:04,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 12:03:04,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 280270a4e0c33d56bfba43ed747050c9, server=jenkins-hbase4.apache.org,44723,1676203381600 in 197 msec 2023-02-12 12:03:04,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 12:03:04,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=280270a4e0c33d56bfba43ed747050c9, ASSIGN in 365 msec 2023-02-12 12:03:04,141 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:04,141 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203384141"}]},"ts":"1676203384141"} 2023-02-12 12:03:04,145 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 12:03:04,148 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:04,151 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 549 msec 2023-02-12 12:03:04,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 12:03:04,217 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:04,217 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:04,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 12:03:04,276 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:04,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-02-12 12:03:04,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 12:03:04,300 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:04,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-12 12:03:04,316 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 12:03:04,318 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 12:03:04,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.648sec 2023-02-12 12:03:04,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 12:03:04,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 12:03:04,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 12:03:04,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42491,1676203380318-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 12:03:04,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42491,1676203380318-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 12:03:04,360 DEBUG [Listener at localhost/35477] zookeeper.ReadOnlyZKClient(139): Connect 0x3ef65de3 to 127.0.0.1:59386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:04,365 DEBUG [Listener at localhost/35477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b8ae91a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:04,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 12:03:04,419 DEBUG [hconnection-0x725c3d69-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:04,431 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58856, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:04,441 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:04,441 DEBUG [Listener at localhost/35477] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 12:03:04,451 DEBUG [Listener at localhost/35477] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 12:03:04,454 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 12:03:04,459 INFO [Listener at localhost/35477] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 12:03:04,465 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 12:03:04,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 12:03:04,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:37778 deadline: 1676203444463, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 12:03:04,484 INFO [Listener at localhost/35477] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 12:03:04,500 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:04,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 12:03:04,505 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:04,508 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:04,512 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 12:03:04,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:04,532 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:04,532 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:04,532 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:04,532 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:04,533 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:04,533 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525 empty. 2023-02-12 12:03:04,533 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18 empty. 2023-02-12 12:03:04,533 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:04,533 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:04,533 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:04,535 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:04,535 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:04,535 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0 empty. 2023-02-12 12:03:04,536 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391 empty. 2023-02-12 12:03:04,536 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543 empty. 2023-02-12 12:03:04,536 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:04,536 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075 empty. 2023-02-12 12:03:04,536 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b empty. 2023-02-12 12:03:04,536 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:04,537 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c empty. 2023-02-12 12:03:04,537 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:04,537 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:04,537 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:04,537 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:04,537 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:04,538 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:04,538 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4 empty. 2023-02-12 12:03:04,539 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:04,539 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358 empty. 2023-02-12 12:03:04,539 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:04,539 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 12:03:04,560 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:04,562 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 75df4fb9fe6b06c7b9a0a55f7f39d525, NAME => 'testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,563 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => bdbe768f21d7c9573c20547dbbac0f18, NAME => 'testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,566 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 72033e60a7bcdebea0d28f7c2147874b, NAME => 'testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,615 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 72033e60a7bcdebea0d28f7c2147874b, disabling compactions & flushes 2023-02-12 12:03:04,616 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:04,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing bdbe768f21d7c9573c20547dbbac0f18, disabling compactions & flushes 2023-02-12 12:03:04,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:04,616 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:04,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. after waiting 0 ms 2023-02-12 12:03:04,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:04,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:04,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. after waiting 0 ms 2023-02-12 12:03:04,616 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:04,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:04,616 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 72033e60a7bcdebea0d28f7c2147874b: Waiting for close lock at 1676203384615Disabling compacts and flushes for region at 1676203384615Disabling writes for close at 1676203384616 (+1 ms)Writing region close event to WAL at 1676203384616Closed at 1676203384616 2023-02-12 12:03:04,617 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:04,617 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for bdbe768f21d7c9573c20547dbbac0f18: Waiting for close lock at 1676203384616Disabling compacts and flushes for region at 1676203384616Disabling writes for close at 1676203384616Writing region close event to WAL at 1676203384617 (+1 ms)Closed at 1676203384617 2023-02-12 12:03:04,617 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 78294cc27746b50a7ce4dd4247511391, NAME => 'testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,618 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c5446be50ca61a97be28627a3b4b52c0, NAME => 'testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 75df4fb9fe6b06c7b9a0a55f7f39d525, disabling compactions & flushes 2023-02-12 12:03:04,618 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:04,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:04,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. after waiting 0 ms 2023-02-12 12:03:04,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:04,618 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:04,618 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 75df4fb9fe6b06c7b9a0a55f7f39d525: Waiting for close lock at 1676203384618Disabling compacts and flushes for region at 1676203384618Disabling writes for close at 1676203384618Writing region close event to WAL at 1676203384618Closed at 1676203384618 2023-02-12 12:03:04,619 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 92df73bf06fd08e56275a83e22a49358, NAME => 'testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:04,657 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 92df73bf06fd08e56275a83e22a49358, disabling compactions & flushes 2023-02-12 12:03:04,658 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:04,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:04,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 78294cc27746b50a7ce4dd4247511391, disabling compactions & flushes 2023-02-12 12:03:04,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. after waiting 0 ms 2023-02-12 12:03:04,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:04,658 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:04,658 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:04,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c5446be50ca61a97be28627a3b4b52c0, disabling compactions & flushes 2023-02-12 12:03:04,659 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 92df73bf06fd08e56275a83e22a49358: Waiting for close lock at 1676203384658Disabling compacts and flushes for region at 1676203384658Disabling writes for close at 1676203384658Writing region close event to WAL at 1676203384658Closed at 1676203384658 2023-02-12 12:03:04,659 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:04,658 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:04,659 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:04,659 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. after waiting 0 ms 2023-02-12 12:03:04,659 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. after waiting 0 ms 2023-02-12 12:03:04,659 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:04,659 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => de503667a307f5dc3ac8248ab10b0543, NAME => 'testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,659 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:04,659 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:04,660 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 78294cc27746b50a7ce4dd4247511391: Waiting for close lock at 1676203384658Disabling compacts and flushes for region at 1676203384658Disabling writes for close at 1676203384659 (+1 ms)Writing region close event to WAL at 1676203384659Closed at 1676203384659 2023-02-12 12:03:04,661 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9f9428638f28b9f7dfb29cdeb2f5c32c, NAME => 'testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,660 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:04,661 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c5446be50ca61a97be28627a3b4b52c0: Waiting for close lock at 1676203384658Disabling compacts and flushes for region at 1676203384658Disabling writes for close at 1676203384659 (+1 ms)Writing region close event to WAL at 1676203384660 (+1 ms)Closed at 1676203384660 2023-02-12 12:03:04,662 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 374fb48868fc34b353e6550fdfb28075, NAME => 'testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,690 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,691 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 374fb48868fc34b353e6550fdfb28075, disabling compactions & flushes 2023-02-12 12:03:04,691 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:04,691 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:04,691 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. after waiting 0 ms 2023-02-12 12:03:04,691 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:04,691 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:04,691 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 374fb48868fc34b353e6550fdfb28075: Waiting for close lock at 1676203384691Disabling compacts and flushes for region at 1676203384691Disabling writes for close at 1676203384691Writing region close event to WAL at 1676203384691Closed at 1676203384691 2023-02-12 12:03:04,693 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,693 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 89b0bf71a2f758b674372969fa5b1cd4, NAME => 'testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp 2023-02-12 12:03:04,693 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9f9428638f28b9f7dfb29cdeb2f5c32c, disabling compactions & flushes 2023-02-12 12:03:04,694 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:04,694 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:04,694 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. after waiting 0 ms 2023-02-12 12:03:04,694 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:04,694 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,694 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:04,695 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing de503667a307f5dc3ac8248ab10b0543, disabling compactions & flushes 2023-02-12 12:03:04,695 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9f9428638f28b9f7dfb29cdeb2f5c32c: Waiting for close lock at 1676203384693Disabling compacts and flushes for region at 1676203384693Disabling writes for close at 1676203384694 (+1 ms)Writing region close event to WAL at 1676203384694Closed at 1676203384694 2023-02-12 12:03:04,695 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:04,695 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:04,695 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. after waiting 0 ms 2023-02-12 12:03:04,695 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:04,695 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:04,696 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for de503667a307f5dc3ac8248ab10b0543: Waiting for close lock at 1676203384695Disabling compacts and flushes for region at 1676203384695Disabling writes for close at 1676203384695Writing region close event to WAL at 1676203384695Closed at 1676203384695 2023-02-12 12:03:04,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:04,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 89b0bf71a2f758b674372969fa5b1cd4, disabling compactions & flushes 2023-02-12 12:03:04,708 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:04,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:04,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. after waiting 0 ms 2023-02-12 12:03:04,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:04,709 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:04,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 89b0bf71a2f758b674372969fa5b1cd4: Waiting for close lock at 1676203384708Disabling compacts and flushes for region at 1676203384708Disabling writes for close at 1676203384709 (+1 ms)Writing region close event to WAL at 1676203384709Closed at 1676203384709 2023-02-12 12:03:04,714 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:04,715 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203384715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203384715"}]},"ts":"1676203384715"} 2023-02-12 12:03:04,774 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 12:03:04,776 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:04,777 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203384776"}]},"ts":"1676203384776"} 2023-02-12 12:03:04,780 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 12:03:04,785 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:04,798 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:04,798 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:04,798 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:04,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=75df4fb9fe6b06c7b9a0a55f7f39d525, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bdbe768f21d7c9573c20547dbbac0f18, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=72033e60a7bcdebea0d28f7c2147874b, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=78294cc27746b50a7ce4dd4247511391, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c5446be50ca61a97be28627a3b4b52c0, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=92df73bf06fd08e56275a83e22a49358, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=de503667a307f5dc3ac8248ab10b0543, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9f9428638f28b9f7dfb29cdeb2f5c32c, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=374fb48868fc34b353e6550fdfb28075, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=89b0bf71a2f758b674372969fa5b1cd4, ASSIGN}] 2023-02-12 12:03:04,803 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=89b0bf71a2f758b674372969fa5b1cd4, ASSIGN 2023-02-12 12:03:04,803 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9f9428638f28b9f7dfb29cdeb2f5c32c, ASSIGN 2023-02-12 12:03:04,804 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=374fb48868fc34b353e6550fdfb28075, ASSIGN 2023-02-12 12:03:04,804 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=de503667a307f5dc3ac8248ab10b0543, ASSIGN 2023-02-12 12:03:04,806 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=92df73bf06fd08e56275a83e22a49358, ASSIGN 2023-02-12 12:03:04,806 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9f9428638f28b9f7dfb29cdeb2f5c32c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44723,1676203381600; forceNewPlan=false, retain=false 2023-02-12 12:03:04,806 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=de503667a307f5dc3ac8248ab10b0543, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38721,1676203381550; forceNewPlan=false, retain=false 2023-02-12 12:03:04,806 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=89b0bf71a2f758b674372969fa5b1cd4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44723,1676203381600; forceNewPlan=false, retain=false 2023-02-12 12:03:04,807 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=374fb48868fc34b353e6550fdfb28075, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38721,1676203381550; forceNewPlan=false, retain=false 2023-02-12 12:03:04,808 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=92df73bf06fd08e56275a83e22a49358, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44723,1676203381600; forceNewPlan=false, retain=false 2023-02-12 12:03:04,808 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c5446be50ca61a97be28627a3b4b52c0, ASSIGN 2023-02-12 12:03:04,808 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=78294cc27746b50a7ce4dd4247511391, ASSIGN 2023-02-12 12:03:04,808 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bdbe768f21d7c9573c20547dbbac0f18, ASSIGN 2023-02-12 12:03:04,809 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=72033e60a7bcdebea0d28f7c2147874b, ASSIGN 2023-02-12 12:03:04,810 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=75df4fb9fe6b06c7b9a0a55f7f39d525, ASSIGN 2023-02-12 12:03:04,811 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c5446be50ca61a97be28627a3b4b52c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44723,1676203381600; forceNewPlan=false, retain=false 2023-02-12 12:03:04,811 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=78294cc27746b50a7ce4dd4247511391, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38721,1676203381550; forceNewPlan=false, retain=false 2023-02-12 12:03:04,811 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=72033e60a7bcdebea0d28f7c2147874b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38721,1676203381550; forceNewPlan=false, retain=false 2023-02-12 12:03:04,811 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bdbe768f21d7c9573c20547dbbac0f18, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44723,1676203381600; forceNewPlan=false, retain=false 2023-02-12 12:03:04,812 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=75df4fb9fe6b06c7b9a0a55f7f39d525, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38721,1676203381550; forceNewPlan=false, retain=false 2023-02-12 12:03:04,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:04,956 INFO [jenkins-hbase4:42491] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 12:03:04,959 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c5446be50ca61a97be28627a3b4b52c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:04,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9f9428638f28b9f7dfb29cdeb2f5c32c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:04,959 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=92df73bf06fd08e56275a83e22a49358, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:04,959 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=bdbe768f21d7c9573c20547dbbac0f18, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:04,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=89b0bf71a2f758b674372969fa5b1cd4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:04,960 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384959"}]},"ts":"1676203384959"} 2023-02-12 12:03:04,960 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384959"}]},"ts":"1676203384959"} 2023-02-12 12:03:04,960 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203384959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384959"}]},"ts":"1676203384959"} 2023-02-12 12:03:04,960 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384959"}]},"ts":"1676203384959"} 2023-02-12 12:03:04,960 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384959"}]},"ts":"1676203384959"} 2023-02-12 12:03:04,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 92df73bf06fd08e56275a83e22a49358, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:04,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure 9f9428638f28b9f7dfb29cdeb2f5c32c, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:04,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 89b0bf71a2f758b674372969fa5b1cd4, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:04,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure c5446be50ca61a97be28627a3b4b52c0, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:04,972 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=72033e60a7bcdebea0d28f7c2147874b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:04,972 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384972"}]},"ts":"1676203384972"} 2023-02-12 12:03:04,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure bdbe768f21d7c9573c20547dbbac0f18, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:04,974 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=78294cc27746b50a7ce4dd4247511391, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:04,975 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384974"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384974"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384974"}]},"ts":"1676203384974"} 2023-02-12 12:03:04,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 72033e60a7bcdebea0d28f7c2147874b, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:04,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure 78294cc27746b50a7ce4dd4247511391, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:04,980 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=374fb48868fc34b353e6550fdfb28075, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:04,980 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=de503667a307f5dc3ac8248ab10b0543, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:04,980 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384980"}]},"ts":"1676203384980"} 2023-02-12 12:03:04,980 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203384980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384980"}]},"ts":"1676203384980"} 2023-02-12 12:03:04,983 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=75df4fb9fe6b06c7b9a0a55f7f39d525, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:04,983 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203384983"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203384983"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203384983"}]},"ts":"1676203384983"} 2023-02-12 12:03:04,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 374fb48868fc34b353e6550fdfb28075, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:04,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=17, state=RUNNABLE; OpenRegionProcedure de503667a307f5dc3ac8248ab10b0543, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:04,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 75df4fb9fe6b06c7b9a0a55f7f39d525, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:05,130 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:05,131 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:05,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:05,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:05,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 92df73bf06fd08e56275a83e22a49358, NAME => 'testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 12:03:05,169 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57050, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:05,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:05,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:05,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:05,184 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:05,191 DEBUG [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1 2023-02-12 12:03:05,191 DEBUG [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1 2023-02-12 12:03:05,191 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92df73bf06fd08e56275a83e22a49358 columnFamilyName f1 2023-02-12 12:03:05,193 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(310): Store=92df73bf06fd08e56275a83e22a49358/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,193 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:05,195 DEBUG [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2 2023-02-12 12:03:05,195 DEBUG [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2 2023-02-12 12:03:05,196 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92df73bf06fd08e56275a83e22a49358 columnFamilyName f2 2023-02-12 12:03:05,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:05,198 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(310): Store=92df73bf06fd08e56275a83e22a49358/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 374fb48868fc34b353e6550fdfb28075, NAME => 'testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 12:03:05,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:05,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:05,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:05,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:05,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:05,203 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:05,205 DEBUG [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1 2023-02-12 12:03:05,205 DEBUG [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1 2023-02-12 12:03:05,205 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 374fb48868fc34b353e6550fdfb28075 columnFamilyName f1 2023-02-12 12:03:05,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,206 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(310): Store=374fb48868fc34b353e6550fdfb28075/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,207 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:05,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:05,209 DEBUG [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2 2023-02-12 12:03:05,209 DEBUG [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2 2023-02-12 12:03:05,209 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 374fb48868fc34b353e6550fdfb28075 columnFamilyName f2 2023-02-12 12:03:05,210 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(310): Store=374fb48868fc34b353e6550fdfb28075/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:05,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:05,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 92df73bf06fd08e56275a83e22a49358; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60653729, jitterRate=-0.09618900716304779}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 92df73bf06fd08e56275a83e22a49358: Running coprocessor pre-open hook at 1676203385170Writing region info on filesystem at 1676203385170Initializing all the Stores at 1676203385174 (+4 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385175 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385184 (+9 ms)Cleaning up temporary data from old regions at 1676203385203 (+19 ms)Cleaning up detritus from prior splits at 1676203385204 (+1 ms)Running coprocessor post-open hooks at 1676203385213 (+9 ms)Region opened successfully at 1676203385213 2023-02-12 12:03:05,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358., pid=21, masterSystemTime=1676203385135 2023-02-12 12:03:05,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:05,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:05,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:05,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:05,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5446be50ca61a97be28627a3b4b52c0, NAME => 'testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 12:03:05,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:05,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:05,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:05,224 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=92df73bf06fd08e56275a83e22a49358, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:05,224 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203385224"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385224"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385224"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385224"}]},"ts":"1676203385224"} 2023-02-12 12:03:05,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 374fb48868fc34b353e6550fdfb28075; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67296667, jitterRate=0.0027984827756881714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 374fb48868fc34b353e6550fdfb28075: Running coprocessor pre-open hook at 1676203385201Writing region info on filesystem at 1676203385201Initializing all the Stores at 1676203385202 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385202Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385203 (+1 ms)Cleaning up temporary data from old regions at 1676203385214 (+11 ms)Cleaning up detritus from prior splits at 1676203385214Running coprocessor post-open hooks at 1676203385226 (+12 ms)Region opened successfully at 1676203385226 2023-02-12 12:03:05,228 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:05,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075., pid=28, masterSystemTime=1676203385130 2023-02-12 12:03:05,232 DEBUG [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1 2023-02-12 12:03:05,232 DEBUG [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1 2023-02-12 12:03:05,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-12 12:03:05,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 92df73bf06fd08e56275a83e22a49358, server=jenkins-hbase4.apache.org,44723,1676203381600 in 264 msec 2023-02-12 12:03:05,233 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5446be50ca61a97be28627a3b4b52c0 columnFamilyName f1 2023-02-12 12:03:05,233 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(310): Store=c5446be50ca61a97be28627a3b4b52c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,234 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:05,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:05,236 DEBUG [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2 2023-02-12 12:03:05,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:05,236 DEBUG [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2 2023-02-12 12:03:05,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:05,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => de503667a307f5dc3ac8248ab10b0543, NAME => 'testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 12:03:05,237 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5446be50ca61a97be28627a3b4b52c0 columnFamilyName f2 2023-02-12 12:03:05,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:05,237 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=374fb48868fc34b353e6550fdfb28075, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:05,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=92df73bf06fd08e56275a83e22a49358, ASSIGN in 434 msec 2023-02-12 12:03:05,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:05,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:05,238 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203385237"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385237"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385237"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385237"}]},"ts":"1676203385237"} 2023-02-12 12:03:05,238 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(310): Store=c5446be50ca61a97be28627a3b4b52c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:05,241 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:05,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:05,243 DEBUG [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1 2023-02-12 12:03:05,243 DEBUG [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1 2023-02-12 12:03:05,244 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de503667a307f5dc3ac8248ab10b0543 columnFamilyName f1 2023-02-12 12:03:05,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,244 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(310): Store=de503667a307f5dc3ac8248ab10b0543/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,245 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:05,248 DEBUG [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2 2023-02-12 12:03:05,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-12 12:03:05,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:05,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 374fb48868fc34b353e6550fdfb28075, server=jenkins-hbase4.apache.org,38721,1676203381550 in 259 msec 2023-02-12 12:03:05,248 DEBUG [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2 2023-02-12 12:03:05,250 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de503667a307f5dc3ac8248ab10b0543 columnFamilyName f2 2023-02-12 12:03:05,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=374fb48868fc34b353e6550fdfb28075, ASSIGN in 449 msec 2023-02-12 12:03:05,251 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(310): Store=de503667a307f5dc3ac8248ab10b0543/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:05,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:05,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c5446be50ca61a97be28627a3b4b52c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73507212, jitterRate=0.09534281492233276}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c5446be50ca61a97be28627a3b4b52c0: Running coprocessor pre-open hook at 1676203385224Writing region info on filesystem at 1676203385224Initializing all the Stores at 1676203385225 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385225Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385228 (+3 ms)Cleaning up temporary data from old regions at 1676203385242 (+14 ms)Cleaning up detritus from prior splits at 1676203385243 (+1 ms)Running coprocessor post-open hooks at 1676203385254 (+11 ms)Region opened successfully at 1676203385254 2023-02-12 12:03:05,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0., pid=24, masterSystemTime=1676203385135 2023-02-12 12:03:05,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:05,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:05,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:05,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bdbe768f21d7c9573c20547dbbac0f18, NAME => 'testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 12:03:05,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:05,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:05,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:05,260 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c5446be50ca61a97be28627a3b4b52c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:05,260 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203385260"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385260"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385260"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385260"}]},"ts":"1676203385260"} 2023-02-12 12:03:05,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:05,262 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:05,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-12 12:03:05,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure c5446be50ca61a97be28627a3b4b52c0, server=jenkins-hbase4.apache.org,44723,1676203381600 in 292 msec 2023-02-12 12:03:05,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened de503667a307f5dc3ac8248ab10b0543; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70351540, jitterRate=0.04831963777542114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,267 DEBUG [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1 2023-02-12 12:03:05,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for de503667a307f5dc3ac8248ab10b0543: Running coprocessor pre-open hook at 1676203385238Writing region info on filesystem at 1676203385238Initializing all the Stores at 1676203385239 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385239Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385240 (+1 ms)Cleaning up temporary data from old regions at 1676203385255 (+15 ms)Cleaning up detritus from prior splits at 1676203385257 (+2 ms)Running coprocessor post-open hooks at 1676203385267 (+10 ms)Region opened successfully at 1676203385267 2023-02-12 12:03:05,267 DEBUG [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1 2023-02-12 12:03:05,267 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdbe768f21d7c9573c20547dbbac0f18 columnFamilyName f1 2023-02-12 12:03:05,269 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(310): Store=bdbe768f21d7c9573c20547dbbac0f18/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,269 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:05,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c5446be50ca61a97be28627a3b4b52c0, ASSIGN in 467 msec 2023-02-12 12:03:05,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543., pid=29, masterSystemTime=1676203385130 2023-02-12 12:03:05,274 DEBUG [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2 2023-02-12 12:03:05,274 DEBUG [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2 2023-02-12 12:03:05,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:05,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:05,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:05,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 78294cc27746b50a7ce4dd4247511391, NAME => 'testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 12:03:05,275 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdbe768f21d7c9573c20547dbbac0f18 columnFamilyName f2 2023-02-12 12:03:05,275 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=de503667a307f5dc3ac8248ab10b0543, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:05,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:05,275 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203385275"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385275"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385275"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385275"}]},"ts":"1676203385275"} 2023-02-12 12:03:05,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:05,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:05,276 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(310): Store=bdbe768f21d7c9573c20547dbbac0f18/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:05,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:05,279 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:05,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,282 DEBUG [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1 2023-02-12 12:03:05,282 DEBUG [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1 2023-02-12 12:03:05,282 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78294cc27746b50a7ce4dd4247511391 columnFamilyName f1 2023-02-12 12:03:05,283 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(310): Store=78294cc27746b50a7ce4dd4247511391/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=17 2023-02-12 12:03:05,283 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:05,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=17, state=SUCCESS; OpenRegionProcedure de503667a307f5dc3ac8248ab10b0543, server=jenkins-hbase4.apache.org,38721,1676203381550 in 294 msec 2023-02-12 12:03:05,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:05,287 DEBUG [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2 2023-02-12 12:03:05,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=de503667a307f5dc3ac8248ab10b0543, ASSIGN in 484 msec 2023-02-12 12:03:05,287 DEBUG [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2 2023-02-12 12:03:05,287 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78294cc27746b50a7ce4dd4247511391 columnFamilyName f2 2023-02-12 12:03:05,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,288 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(310): Store=78294cc27746b50a7ce4dd4247511391/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bdbe768f21d7c9573c20547dbbac0f18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65744304, jitterRate=-0.020333528518676758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bdbe768f21d7c9573c20547dbbac0f18: Running coprocessor pre-open hook at 1676203385260Writing region info on filesystem at 1676203385260Initializing all the Stores at 1676203385262 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385262Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385262Cleaning up temporary data from old regions at 1676203385279 (+17 ms)Cleaning up detritus from prior splits at 1676203385280 (+1 ms)Running coprocessor post-open hooks at 1676203385289 (+9 ms)Region opened successfully at 1676203385289 2023-02-12 12:03:05,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:05,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:05,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18., pid=25, masterSystemTime=1676203385135 2023-02-12 12:03:05,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:05,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:05,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:05,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 89b0bf71a2f758b674372969fa5b1cd4, NAME => 'testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 12:03:05,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:05,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:05,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:05,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=bdbe768f21d7c9573c20547dbbac0f18, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:05,295 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203385295"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385295"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385295"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385295"}]},"ts":"1676203385295"} 2023-02-12 12:03:05,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:05,298 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:05,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,300 DEBUG [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/f1 2023-02-12 12:03:05,300 DEBUG [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/f1 2023-02-12 12:03:05,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 78294cc27746b50a7ce4dd4247511391; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66195910, jitterRate=-0.013604074716567993}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 78294cc27746b50a7ce4dd4247511391: Running coprocessor pre-open hook at 1676203385276Writing region info on filesystem at 1676203385276Initializing all the Stores at 1676203385278 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385278Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385279 (+1 ms)Cleaning up temporary data from old regions at 1676203385291 (+12 ms)Cleaning up detritus from prior splits at 1676203385292 (+1 ms)Running coprocessor post-open hooks at 1676203385301 (+9 ms)Region opened successfully at 1676203385301 2023-02-12 12:03:05,301 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89b0bf71a2f758b674372969fa5b1cd4 columnFamilyName f1 2023-02-12 12:03:05,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391., pid=27, masterSystemTime=1676203385130 2023-02-12 12:03:05,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-12 12:03:05,302 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] regionserver.HStore(310): Store=89b0bf71a2f758b674372969fa5b1cd4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure bdbe768f21d7c9573c20547dbbac0f18, server=jenkins-hbase4.apache.org,44723,1676203381600 in 325 msec 2023-02-12 12:03:05,302 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:05,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:05,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bdbe768f21d7c9573c20547dbbac0f18, ASSIGN in 503 msec 2023-02-12 12:03:05,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:05,305 DEBUG [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/f2 2023-02-12 12:03:05,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:05,305 DEBUG [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/f2 2023-02-12 12:03:05,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 72033e60a7bcdebea0d28f7c2147874b, NAME => 'testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 12:03:05,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=78294cc27746b50a7ce4dd4247511391, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:05,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:05,305 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89b0bf71a2f758b674372969fa5b1cd4 columnFamilyName f2 2023-02-12 12:03:05,305 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203385305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385305"}]},"ts":"1676203385305"} 2023-02-12 12:03:05,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:05,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:05,306 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] regionserver.HStore(310): Store=89b0bf71a2f758b674372969fa5b1cd4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:05,309 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:05,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:05,311 DEBUG [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1 2023-02-12 12:03:05,311 DEBUG [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1 2023-02-12 12:03:05,311 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72033e60a7bcdebea0d28f7c2147874b columnFamilyName f1 2023-02-12 12:03:05,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-12 12:03:05,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure 78294cc27746b50a7ce4dd4247511391, server=jenkins-hbase4.apache.org,38721,1676203381550 in 332 msec 2023-02-12 12:03:05,312 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(310): Store=72033e60a7bcdebea0d28f7c2147874b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,312 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:05,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=78294cc27746b50a7ce4dd4247511391, ASSIGN in 513 msec 2023-02-12 12:03:05,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:05,317 DEBUG [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2 2023-02-12 12:03:05,317 DEBUG [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2 2023-02-12 12:03:05,317 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72033e60a7bcdebea0d28f7c2147874b columnFamilyName f2 2023-02-12 12:03:05,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,318 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(310): Store=72033e60a7bcdebea0d28f7c2147874b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 89b0bf71a2f758b674372969fa5b1cd4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74742917, jitterRate=0.11375625431537628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 89b0bf71a2f758b674372969fa5b1cd4: Running coprocessor pre-open hook at 1676203385295Writing region info on filesystem at 1676203385295Initializing all the Stores at 1676203385298 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385298Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385298Cleaning up temporary data from old regions at 1676203385311 (+13 ms)Cleaning up detritus from prior splits at 1676203385311Running coprocessor post-open hooks at 1676203385319 (+8 ms)Region opened successfully at 1676203385319 2023-02-12 12:03:05,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:05,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4., pid=23, masterSystemTime=1676203385135 2023-02-12 12:03:05,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:05,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:05,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:05,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:05,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9f9428638f28b9f7dfb29cdeb2f5c32c, NAME => 'testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 12:03:05,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:05,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:05,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:05,323 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=89b0bf71a2f758b674372969fa5b1cd4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:05,324 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203385323"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385323"}]},"ts":"1676203385323"} 2023-02-12 12:03:05,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,325 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:05,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:05,328 DEBUG [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1 2023-02-12 12:03:05,328 DEBUG [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1 2023-02-12 12:03:05,329 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f9428638f28b9f7dfb29cdeb2f5c32c columnFamilyName f1 2023-02-12 12:03:05,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-12 12:03:05,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 89b0bf71a2f758b674372969fa5b1cd4, server=jenkins-hbase4.apache.org,44723,1676203381600 in 358 msec 2023-02-12 12:03:05,330 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(310): Store=9f9428638f28b9f7dfb29cdeb2f5c32c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,330 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:05,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=89b0bf71a2f758b674372969fa5b1cd4, ASSIGN in 531 msec 2023-02-12 12:03:05,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 72033e60a7bcdebea0d28f7c2147874b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66367065, jitterRate=-0.011053666472434998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 72033e60a7bcdebea0d28f7c2147874b: Running coprocessor pre-open hook at 1676203385306Writing region info on filesystem at 1676203385306Initializing all the Stores at 1676203385308 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385308Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385309 (+1 ms)Cleaning up temporary data from old regions at 1676203385322 (+13 ms)Cleaning up detritus from prior splits at 1676203385322Running coprocessor post-open hooks at 1676203385332 (+10 ms)Region opened successfully at 1676203385332 2023-02-12 12:03:05,332 DEBUG [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2 2023-02-12 12:03:05,332 DEBUG [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2 2023-02-12 12:03:05,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b., pid=26, masterSystemTime=1676203385130 2023-02-12 12:03:05,333 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f9428638f28b9f7dfb29cdeb2f5c32c columnFamilyName f2 2023-02-12 12:03:05,334 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(310): Store=9f9428638f28b9f7dfb29cdeb2f5c32c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:05,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:05,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:05,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:05,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 75df4fb9fe6b06c7b9a0a55f7f39d525, NAME => 'testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 12:03:05,336 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=72033e60a7bcdebea0d28f7c2147874b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:05,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:05,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:05,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:05,337 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203385336"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385336"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385336"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385336"}]},"ts":"1676203385336"} 2023-02-12 12:03:05,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:05,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:05,339 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:05,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,341 DEBUG [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/f1 2023-02-12 12:03:05,341 DEBUG [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/f1 2023-02-12 12:03:05,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-12 12:03:05,342 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75df4fb9fe6b06c7b9a0a55f7f39d525 columnFamilyName f1 2023-02-12 12:03:05,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 72033e60a7bcdebea0d28f7c2147874b, server=jenkins-hbase4.apache.org,38721,1676203381550 in 364 msec 2023-02-12 12:03:05,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:05,343 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] regionserver.HStore(310): Store=75df4fb9fe6b06c7b9a0a55f7f39d525/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,343 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:05,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=72033e60a7bcdebea0d28f7c2147874b, ASSIGN in 543 msec 2023-02-12 12:03:05,346 DEBUG [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/f2 2023-02-12 12:03:05,346 DEBUG [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/f2 2023-02-12 12:03:05,346 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75df4fb9fe6b06c7b9a0a55f7f39d525 columnFamilyName f2 2023-02-12 12:03:05,347 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] regionserver.HStore(310): Store=75df4fb9fe6b06c7b9a0a55f7f39d525/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:05,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:05,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9f9428638f28b9f7dfb29cdeb2f5c32c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66621585, jitterRate=-0.007261022925376892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:05,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9f9428638f28b9f7dfb29cdeb2f5c32c: Running coprocessor pre-open hook at 1676203385323Writing region info on filesystem at 1676203385323Initializing all the Stores at 1676203385325 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385325Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385325Cleaning up temporary data from old regions at 1676203385338 (+13 ms)Cleaning up detritus from prior splits at 1676203385338Running coprocessor post-open hooks at 1676203385350 (+12 ms)Region opened successfully at 1676203385350 2023-02-12 12:03:05,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c., pid=22, masterSystemTime=1676203385135 2023-02-12 12:03:05,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:05,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:05,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:05,354 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=9f9428638f28b9f7dfb29cdeb2f5c32c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:05,354 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203385354"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385354"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385354"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385354"}]},"ts":"1676203385354"} 2023-02-12 12:03:05,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:05,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:05,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 75df4fb9fe6b06c7b9a0a55f7f39d525; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70814509, jitterRate=0.0552184134721756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:05,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 75df4fb9fe6b06c7b9a0a55f7f39d525: Running coprocessor pre-open hook at 1676203385337Writing region info on filesystem at 1676203385337Initializing all the Stores at 1676203385338 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385338Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203385339 (+1 ms)Cleaning up temporary data from old regions at 1676203385351 (+12 ms)Cleaning up detritus from prior splits at 1676203385352 (+1 ms)Running coprocessor post-open hooks at 1676203385359 (+7 ms)Region opened successfully at 1676203385359 2023-02-12 12:03:05,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-12 12:03:05,359 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure 9f9428638f28b9f7dfb29cdeb2f5c32c, server=jenkins-hbase4.apache.org,44723,1676203381600 in 391 msec 2023-02-12 12:03:05,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525., pid=30, masterSystemTime=1676203385130 2023-02-12 12:03:05,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9f9428638f28b9f7dfb29cdeb2f5c32c, ASSIGN in 560 msec 2023-02-12 12:03:05,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:05,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:05,363 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=75df4fb9fe6b06c7b9a0a55f7f39d525, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:05,363 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203385363"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203385363"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203385363"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203385363"}]},"ts":"1676203385363"} 2023-02-12 12:03:05,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-12 12:03:05,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 75df4fb9fe6b06c7b9a0a55f7f39d525, server=jenkins-hbase4.apache.org,38721,1676203381550 in 378 msec 2023-02-12 12:03:05,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 12:03:05,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=75df4fb9fe6b06c7b9a0a55f7f39d525, ASSIGN in 569 msec 2023-02-12 12:03:05,372 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:05,372 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203385372"}]},"ts":"1676203385372"} 2023-02-12 12:03:05,374 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 12:03:05,377 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:05,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 877 msec 2023-02-12 12:03:05,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:05,643 INFO [Listener at localhost/35477] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 12:03:05,643 DEBUG [Listener at localhost/35477] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 12:03:05,645 INFO [Listener at localhost/35477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:05,654 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 12:03:05,655 INFO [Listener at localhost/35477] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:05,655 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 12:03:05,655 INFO [Listener at localhost/35477] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 12:03:05,792 DEBUG [hconnection-0x725c3d69-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:05,880 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57058, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:05,930 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44723] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:05,931 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38721] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:06,202 INFO [Listener at localhost/35477] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 12:03:06,205 INFO [Listener at localhost/35477] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 12:03:06,219 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 12:03:06,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676203386219 (current time:1676203386219). 2023-02-12 12:03:06,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 12:03:06,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] zookeeper.ReadOnlyZKClient(139): Connect 0x55a4d4e2 to 127.0.0.1:59386 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:06,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f46dc25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:06,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:06,235 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58870, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:06,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55a4d4e2 to 127.0.0.1:59386 2023-02-12 12:03:06,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:06,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 12:03:06,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 12:03:06,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 12:03:06,264 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 12:03:06,265 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676203986265 2023-02-12 12:03:06,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 12:03:06,267 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 12:03:06,268 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 12:03:06,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 12:03:06,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 13 msec 2023-02-12 12:03:06,271 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 12:03:06,272 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676203986272 2023-02-12 12:03:06,273 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:06,273 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 12:03:06,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-12 12:03:06,328 INFO [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-12 12:03:06,328 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:06,329 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-12 12:03:06,329 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 12:03:06,330 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:06,330 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 12:03:06,332 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:06,332 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:06,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:06,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:06,332 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:06,333 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:06,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 12:03:06,333 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:06,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 12:03:06,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:06,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:06,334 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:06,334 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:06,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 12:03:06,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 12:03:06,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 12:03:06,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 12:03:06,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 12:03:06,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 12:03:06,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 12:03:06,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 12:03:06,347 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 12:03:06,348 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:06,348 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 12:03:06,348 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 12:03:06,348 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38721,1676203381550' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 12:03:06,349 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 12:03:06,349 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:06,349 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 12:03:06,349 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 12:03:06,349 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44723,1676203381600' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 12:03:06,351 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:06,351 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:06,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:06,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:06,352 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:06,352 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,353 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,353 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:06,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:06,353 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,353 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:06,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 12:03:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:06,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:06,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38721,1676203381550' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 12:03:06,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e630da0[Count = 1] remaining members to acquire global barrier 2023-02-12 12:03:06,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:06,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 12:03:06,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:06,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:06,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:06,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44723,1676203381600' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 12:03:06,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e630da0[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:06,359 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 12:03:06,359 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,362 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,362 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:06,362 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 12:03:06,363 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:06,363 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:06,363 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:06,364 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 12:03:06,364 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:06,364 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:06,364 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:06,364 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. started... 2023-02-12 12:03:06,364 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. started... 2023-02-12 12:03:06,364 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 12:03:06,364 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. started... 2023-02-12 12:03:06,365 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:06,365 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:06,365 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:06,365 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. started... 2023-02-12 12:03:06,365 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. started... 2023-02-12 12:03:06,368 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 12:03:06,368 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:06,368 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:06,369 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. started... 2023-02-12 12:03:06,369 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9f9428638f28b9f7dfb29cdeb2f5c32c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:06,369 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 374fb48868fc34b353e6550fdfb28075 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 12:03:06,369 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 72033e60a7bcdebea0d28f7c2147874b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:06,369 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 92df73bf06fd08e56275a83e22a49358 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:06,371 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 75df4fb9fe6b06c7b9a0a55f7f39d525: 2023-02-12 12:03:06,372 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,373 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.HRegion(2744): Flushing bdbe768f21d7c9573c20547dbbac0f18 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 12:03:06,379 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:06,380 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:06,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:06,384 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:06,384 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:06,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:06,386 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 12:03:06,437 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. completed. 2023-02-12 12:03:06,437 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:06,438 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:06,438 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 12:03:06,438 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. started... 2023-02-12 12:03:06,439 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.HRegion(2744): Flushing de503667a307f5dc3ac8248ab10b0543 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:06,586 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:06,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:06,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:06,589 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 12:03:06,649 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/.tmp/f1/cd46b7e5db3146fca6d791c19150b7b0 2023-02-12 12:03:06,658 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/.tmp/f1/dbc604bf2f1c41b8882c352d5e16b2ea 2023-02-12 12:03:06,660 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/.tmp/f1/5c26a7407cad45c39e68f0363cc2341a 2023-02-12 12:03:06,768 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/.tmp/f2/097a66d9d8264f12990db38cb221a5f2 2023-02-12 12:03:06,779 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/.tmp/f2/20d4279ecf80453380855f1c671aa3dc 2023-02-12 12:03:06,781 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/.tmp/f1/5c26a7407cad45c39e68f0363cc2341a as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/5c26a7407cad45c39e68f0363cc2341a 2023-02-12 12:03:06,790 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/.tmp/f1/dbc604bf2f1c41b8882c352d5e16b2ea as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/dbc604bf2f1c41b8882c352d5e16b2ea 2023-02-12 12:03:06,791 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/5c26a7407cad45c39e68f0363cc2341a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:06,794 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/.tmp/f2/097a66d9d8264f12990db38cb221a5f2 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/097a66d9d8264f12990db38cb221a5f2 2023-02-12 12:03:06,801 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/dbc604bf2f1c41b8882c352d5e16b2ea, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:06,803 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/.tmp/f2/20d4279ecf80453380855f1c671aa3dc as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/20d4279ecf80453380855f1c671aa3dc 2023-02-12 12:03:06,808 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/097a66d9d8264f12990db38cb221a5f2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:06,810 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 72033e60a7bcdebea0d28f7c2147874b in 442ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:06,813 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 12:03:06,813 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/20d4279ecf80453380855f1c671aa3dc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:06,814 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 72033e60a7bcdebea0d28f7c2147874b: 2023-02-12 12:03:06,814 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for de503667a307f5dc3ac8248ab10b0543 in 375ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:06,815 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,816 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:06,816 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/5c26a7407cad45c39e68f0363cc2341a] hfiles 2023-02-12 12:03:06,816 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/5c26a7407cad45c39e68f0363cc2341a for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,820 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for de503667a307f5dc3ac8248ab10b0543: 2023-02-12 12:03:06,820 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,820 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:06,820 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/dbc604bf2f1c41b8882c352d5e16b2ea] hfiles 2023-02-12 12:03:06,820 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/dbc604bf2f1c41b8882c352d5e16b2ea for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,821 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/097a66d9d8264f12990db38cb221a5f2] hfiles 2023-02-12 12:03:06,821 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/097a66d9d8264f12990db38cb221a5f2 for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,825 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/20d4279ecf80453380855f1c671aa3dc] hfiles 2023-02-12 12:03:06,825 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/20d4279ecf80453380855f1c671aa3dc for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,839 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. completed. 2023-02-12 12:03:06,839 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:06,839 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:06,839 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 12:03:06,839 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. started... 2023-02-12 12:03:06,840 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 78294cc27746b50a7ce4dd4247511391 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:06,840 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. completed. 2023-02-12 12:03:06,841 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:06,841 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 12:03:06,859 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/.tmp/f1/48b7f152442740babd74aa4a678c363e 2023-02-12 12:03:06,883 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/.tmp/f2/e92c83cb764241269c70bec13c7c9138 2023-02-12 12:03:06,889 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:06,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:06,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:06,891 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 12:03:06,892 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/.tmp/f1/48b7f152442740babd74aa4a678c363e as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/48b7f152442740babd74aa4a678c363e 2023-02-12 12:03:06,900 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/48b7f152442740babd74aa4a678c363e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:06,901 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/.tmp/f2/e92c83cb764241269c70bec13c7c9138 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/e92c83cb764241269c70bec13c7c9138 2023-02-12 12:03:06,909 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/e92c83cb764241269c70bec13c7c9138, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:06,910 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 78294cc27746b50a7ce4dd4247511391 in 70ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:06,910 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 78294cc27746b50a7ce4dd4247511391: 2023-02-12 12:03:06,911 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,911 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:06,911 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/48b7f152442740babd74aa4a678c363e] hfiles 2023-02-12 12:03:06,911 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/48b7f152442740babd74aa4a678c363e for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,911 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/e92c83cb764241269c70bec13c7c9138] hfiles 2023-02-12 12:03:06,911 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/e92c83cb764241269c70bec13c7c9138 for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:06,924 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. completed. 2023-02-12 12:03:06,924 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:06,924 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 12:03:07,050 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/.tmp/f1/f00be38737ef470abacb47d4a3c37df9 2023-02-12 12:03:07,050 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/.tmp/f1/9426498cf43447e38f7a57d8ce99ff46 2023-02-12 12:03:07,050 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/.tmp/f1/71d0454f0aa244b88251e93215cab86e 2023-02-12 12:03:07,090 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/.tmp/f2/4444fa0bd0674053b7b146c452258152 2023-02-12 12:03:07,096 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/.tmp/f2/7fed9fb8e6674633821b747aaa43c713 2023-02-12 12:03:07,100 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/.tmp/f1/f00be38737ef470abacb47d4a3c37df9 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/f00be38737ef470abacb47d4a3c37df9 2023-02-12 12:03:07,105 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/.tmp/f2/a7a19fba8e784a27838952c5f8213598 2023-02-12 12:03:07,107 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/.tmp/f1/71d0454f0aa244b88251e93215cab86e as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/71d0454f0aa244b88251e93215cab86e 2023-02-12 12:03:07,111 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/f00be38737ef470abacb47d4a3c37df9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:07,112 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/.tmp/f2/4444fa0bd0674053b7b146c452258152 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/4444fa0bd0674053b7b146c452258152 2023-02-12 12:03:07,117 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/.tmp/f1/9426498cf43447e38f7a57d8ce99ff46 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/9426498cf43447e38f7a57d8ce99ff46 2023-02-12 12:03:07,120 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/71d0454f0aa244b88251e93215cab86e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:07,121 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/.tmp/f2/7fed9fb8e6674633821b747aaa43c713 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/7fed9fb8e6674633821b747aaa43c713 2023-02-12 12:03:07,125 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/4444fa0bd0674053b7b146c452258152, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:07,126 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/9426498cf43447e38f7a57d8ce99ff46, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:07,126 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for bdbe768f21d7c9573c20547dbbac0f18 in 754ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:07,126 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for bdbe768f21d7c9573c20547dbbac0f18: 2023-02-12 12:03:07,126 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,126 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:07,126 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/f00be38737ef470abacb47d4a3c37df9] hfiles 2023-02-12 12:03:07,126 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/f00be38737ef470abacb47d4a3c37df9 for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,126 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/4444fa0bd0674053b7b146c452258152] hfiles 2023-02-12 12:03:07,127 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/4444fa0bd0674053b7b146c452258152 for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,127 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/.tmp/f2/a7a19fba8e784a27838952c5f8213598 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/a7a19fba8e784a27838952c5f8213598 2023-02-12 12:03:07,133 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/7fed9fb8e6674633821b747aaa43c713, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:07,134 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9f9428638f28b9f7dfb29cdeb2f5c32c in 766ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:07,134 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9f9428638f28b9f7dfb29cdeb2f5c32c: 2023-02-12 12:03:07,135 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,135 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:07,135 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/71d0454f0aa244b88251e93215cab86e] hfiles 2023-02-12 12:03:07,135 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/71d0454f0aa244b88251e93215cab86e for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,135 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/7fed9fb8e6674633821b747aaa43c713] hfiles 2023-02-12 12:03:07,135 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/7fed9fb8e6674633821b747aaa43c713 for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,142 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/a7a19fba8e784a27838952c5f8213598, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:07,143 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 374fb48868fc34b353e6550fdfb28075 in 774ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:07,143 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 374fb48868fc34b353e6550fdfb28075: 2023-02-12 12:03:07,143 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,143 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:07,143 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/9426498cf43447e38f7a57d8ce99ff46] hfiles 2023-02-12 12:03:07,143 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/9426498cf43447e38f7a57d8ce99ff46 for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,143 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/a7a19fba8e784a27838952c5f8213598] hfiles 2023-02-12 12:03:07,143 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/a7a19fba8e784a27838952c5f8213598 for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,173 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. completed. 2023-02-12 12:03:07,173 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:07,173 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 12:03:07,173 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:07,174 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. started... 2023-02-12 12:03:07,174 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 89b0bf71a2f758b674372969fa5b1cd4: 2023-02-12 12:03:07,175 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,175 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:07,175 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:07,175 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:07,175 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. completed. 2023-02-12 12:03:07,175 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:07,175 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 12:03:07,175 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 12:03:07,175 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,176 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 12:03:07,176 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38721,1676203381550' in zk 2023-02-12 12:03:07,176 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. completed. 2023-02-12 12:03:07,176 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:07,176 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 12:03:07,176 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:07,176 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. started... 2023-02-12 12:03:07,178 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c5446be50ca61a97be28627a3b4b52c0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:07,181 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,182 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 12:03:07,182 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:07,182 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 12:03:07,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:07,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:07,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:07,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 12:03:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:07,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 12:03:07,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38721,1676203381550': 2023-02-12 12:03:07,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38721,1676203381550' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 12:03:07,196 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/.tmp/f2/3701d3d94ebb4e4d954fbd1068bc75dc 2023-02-12 12:03:07,204 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/.tmp/f1/cd46b7e5db3146fca6d791c19150b7b0 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/cd46b7e5db3146fca6d791c19150b7b0 2023-02-12 12:03:07,230 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/cd46b7e5db3146fca6d791c19150b7b0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:07,232 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/.tmp/f2/3701d3d94ebb4e4d954fbd1068bc75dc as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/3701d3d94ebb4e4d954fbd1068bc75dc 2023-02-12 12:03:07,232 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. completed. 2023-02-12 12:03:07,232 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:07,232 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 12:03:07,250 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/3701d3d94ebb4e4d954fbd1068bc75dc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:07,251 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 92df73bf06fd08e56275a83e22a49358 in 882ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:07,252 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 92df73bf06fd08e56275a83e22a49358: 2023-02-12 12:03:07,252 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,252 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:07,252 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/cd46b7e5db3146fca6d791c19150b7b0] hfiles 2023-02-12 12:03:07,252 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/cd46b7e5db3146fca6d791c19150b7b0 for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,252 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/3701d3d94ebb4e4d954fbd1068bc75dc] hfiles 2023-02-12 12:03:07,252 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/3701d3d94ebb4e4d954fbd1068bc75dc for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,253 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/.tmp/f1/342c7e47f75b4d8192f6e8fcd57b3fdc 2023-02-12 12:03:07,273 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. completed. 2023-02-12 12:03:07,273 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:07,273 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 12:03:07,280 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/.tmp/f2/68377fb0efa24dfbadc8a96d51a387ed 2023-02-12 12:03:07,288 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/.tmp/f1/342c7e47f75b4d8192f6e8fcd57b3fdc as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/342c7e47f75b4d8192f6e8fcd57b3fdc 2023-02-12 12:03:07,295 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/342c7e47f75b4d8192f6e8fcd57b3fdc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:07,297 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/.tmp/f2/68377fb0efa24dfbadc8a96d51a387ed as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/68377fb0efa24dfbadc8a96d51a387ed 2023-02-12 12:03:07,306 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/68377fb0efa24dfbadc8a96d51a387ed, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:07,308 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c5446be50ca61a97be28627a3b4b52c0 in 131ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:07,308 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c5446be50ca61a97be28627a3b4b52c0: 2023-02-12 12:03:07,308 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,308 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:07,308 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/342c7e47f75b4d8192f6e8fcd57b3fdc] hfiles 2023-02-12 12:03:07,308 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/342c7e47f75b4d8192f6e8fcd57b3fdc for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,308 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/68377fb0efa24dfbadc8a96d51a387ed] hfiles 2023-02-12 12:03:07,309 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/68377fb0efa24dfbadc8a96d51a387ed for snapshot=testWithMapReduceMultiRegion 2023-02-12 12:03:07,321 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. completed. 2023-02-12 12:03:07,321 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:07,321 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 12:03:07,321 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 12:03:07,321 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,321 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 12:03:07,321 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44723,1676203381600' in zk 2023-02-12 12:03:07,324 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 12:03:07,324 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,324 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:07,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:07,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:07,324 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 12:03:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:07,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 12:03:07,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 12:03:07,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44723,1676203381600': 2023-02-12 12:03:07,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44723,1676203381600' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 12:03:07,330 INFO [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-12 12:03:07,330 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:07,330 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:07,330 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-12 12:03:07,330 INFO [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 12:03:07,333 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,333 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,333 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:07,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,333 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,333 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:07,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:07,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:07,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:07,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:07,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:07,335 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 12:03:07,336 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:07,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 12:03:07,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,338 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:07,339 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 12:03:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,358 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:07,358 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:07,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:07,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:07,358 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:07,358 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:07,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:07,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-12 12:03:07,358 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,358 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:07,359 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 12:03:07,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-12 12:03:07,359 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:07,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:07,359 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 12:03:07,359 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:07,359 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:07,360 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:07,360 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 12:03:07,360 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 12:03:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:07,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 12:03:07,399 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:07,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:07,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:07,406 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-12 12:03:07,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-12 12:03:07,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-12 12:03:07,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 12:03:07,532 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 12:03:07,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676203386267Consolidate snapshot: testWithMapReduceMultiRegion at 1676203387359 (+1092 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676203387359Writing data manifest for testWithMapReduceMultiRegion at 1676203387412 (+53 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676203387449 (+37 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676203387531 (+82 ms) 2023-02-12 12:03:07,533 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 12:03:07,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2640 sec 2023-02-12 12:03:08,406 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:08,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:08,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 12:03:08,409 INFO [Listener at localhost/35477] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 12:03:08,423 INFO [Listener at localhost/35477] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 12:03:08,435 INFO [Listener at localhost/35477] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 12:03:08,508 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44723] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:08,513 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38721] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:08,666 INFO [Listener at localhost/35477] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 12:03:08,683 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 12:03:08,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 12:03:08,688 INFO [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 12:03:08,688 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:08,689 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 12:03:08,689 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 12:03:08,689 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:08,689 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:08,691 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:08,691 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:08,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:08,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:08,691 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:08,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:08,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:08,691 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:08,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:08,691 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:08,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:08,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:08,692 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:08,692 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:08,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:08,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:08,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:08,692 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 12:03:08,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:08,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:08,693 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 12:03:08,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 12:03:08,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 12:03:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 12:03:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:08,694 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 12:03:08,695 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 12:03:08,695 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:08,695 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 12:03:08,698 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:08,698 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:08,698 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. started... 2023-02-12 12:03:08,698 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:08,698 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. started... 2023-02-12 12:03:08,698 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:08,699 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:08,699 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:08,699 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 374fb48868fc34b353e6550fdfb28075 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 12:03:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 12:03:08,699 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. started... 2023-02-12 12:03:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 12:03:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:08,699 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. started... 2023-02-12 12:03:08,699 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 92df73bf06fd08e56275a83e22a49358 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:08,699 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 75df4fb9fe6b06c7b9a0a55f7f39d525: 2023-02-12 12:03:08,699 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:08,699 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9f9428638f28b9f7dfb29cdeb2f5c32c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 12:03:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:08,699 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. started... 2023-02-12 12:03:08,700 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing bdbe768f21d7c9573c20547dbbac0f18 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 12:03:08,699 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. started... 2023-02-12 12:03:08,699 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:08,701 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. started... 2023-02-12 12:03:08,701 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing de503667a307f5dc3ac8248ab10b0543 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:08,702 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 72033e60a7bcdebea0d28f7c2147874b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:08,773 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/.tmp/f1/2492335ce87a4af6a801cf5acc1390a1 2023-02-12 12:03:08,793 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/.tmp/f1/592ac1d622024745b129550da1b7c5d9 2023-02-12 12:03:08,798 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/.tmp/f1/8a5b2084fe244a02a97c9ed317a3e0b1 2023-02-12 12:03:08,800 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/.tmp/f1/c3fb28b769ca4720835d633b14a8b180 2023-02-12 12:03:08,802 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/.tmp/f1/70805cd4ea8c4ee79592e7519e555a91 2023-02-12 12:03:08,806 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/.tmp/f1/8a7749c3566a4e79a2c60366676abe19 2023-02-12 12:03:08,855 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/.tmp/f2/b9bdaabd7cfa45e88892f622fed6bc02 2023-02-12 12:03:08,856 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/.tmp/f2/992ab275419c4a00834a66a01f2a5643 2023-02-12 12:03:08,864 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/.tmp/f1/c3fb28b769ca4720835d633b14a8b180 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/c3fb28b769ca4720835d633b14a8b180 2023-02-12 12:03:08,864 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/.tmp/f1/8a7749c3566a4e79a2c60366676abe19 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/8a7749c3566a4e79a2c60366676abe19 2023-02-12 12:03:08,865 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/.tmp/f2/6830c4d550d340a5897ef211983b1004 2023-02-12 12:03:08,866 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/.tmp/f2/9f6acd874a4f42809768eaecdf2d94e1 2023-02-12 12:03:08,870 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/.tmp/f2/e168f340f19e44a29c90db796f8560dd 2023-02-12 12:03:08,873 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/.tmp/f2/e0ef4e8fae4346d89f7415b83762994f 2023-02-12 12:03:08,877 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/8a7749c3566a4e79a2c60366676abe19, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:08,877 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/c3fb28b769ca4720835d633b14a8b180, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:08,877 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/.tmp/f1/592ac1d622024745b129550da1b7c5d9 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/592ac1d622024745b129550da1b7c5d9 2023-02-12 12:03:08,879 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/.tmp/f1/8a5b2084fe244a02a97c9ed317a3e0b1 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/8a5b2084fe244a02a97c9ed317a3e0b1 2023-02-12 12:03:08,879 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/.tmp/f2/b9bdaabd7cfa45e88892f622fed6bc02 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/b9bdaabd7cfa45e88892f622fed6bc02 2023-02-12 12:03:08,880 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/.tmp/f2/992ab275419c4a00834a66a01f2a5643 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/992ab275419c4a00834a66a01f2a5643 2023-02-12 12:03:08,883 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/.tmp/f1/70805cd4ea8c4ee79592e7519e555a91 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/70805cd4ea8c4ee79592e7519e555a91 2023-02-12 12:03:08,885 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/.tmp/f1/2492335ce87a4af6a801cf5acc1390a1 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/2492335ce87a4af6a801cf5acc1390a1 2023-02-12 12:03:08,889 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/592ac1d622024745b129550da1b7c5d9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:08,890 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/b9bdaabd7cfa45e88892f622fed6bc02, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:08,890 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/8a5b2084fe244a02a97c9ed317a3e0b1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:08,890 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/.tmp/f2/6830c4d550d340a5897ef211983b1004 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/6830c4d550d340a5897ef211983b1004 2023-02-12 12:03:08,891 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 374fb48868fc34b353e6550fdfb28075 in 192ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:08,892 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 374fb48868fc34b353e6550fdfb28075: 2023-02-12 12:03:08,892 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:08,892 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:08,892 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 12:03:08,892 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. started... 2023-02-12 12:03:08,892 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78294cc27746b50a7ce4dd4247511391 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:08,893 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/.tmp/f2/9f6acd874a4f42809768eaecdf2d94e1 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/9f6acd874a4f42809768eaecdf2d94e1 2023-02-12 12:03:08,896 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/2492335ce87a4af6a801cf5acc1390a1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:08,897 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/.tmp/f2/e0ef4e8fae4346d89f7415b83762994f as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/e0ef4e8fae4346d89f7415b83762994f 2023-02-12 12:03:08,898 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/70805cd4ea8c4ee79592e7519e555a91, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:08,899 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/.tmp/f2/e168f340f19e44a29c90db796f8560dd as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/e168f340f19e44a29c90db796f8560dd 2023-02-12 12:03:08,901 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/6830c4d550d340a5897ef211983b1004, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:08,902 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9f9428638f28b9f7dfb29cdeb2f5c32c in 203ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:08,902 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9f9428638f28b9f7dfb29cdeb2f5c32c: 2023-02-12 12:03:08,902 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:08,906 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 12:03:08,909 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:08,909 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 12:03:08,909 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. started... 2023-02-12 12:03:08,910 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 89b0bf71a2f758b674372969fa5b1cd4: 2023-02-12 12:03:08,910 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:08,910 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/992ab275419c4a00834a66a01f2a5643, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:08,910 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 12:03:08,910 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:08,910 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. started... 2023-02-12 12:03:08,910 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c5446be50ca61a97be28627a3b4b52c0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:08,911 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for bdbe768f21d7c9573c20547dbbac0f18 in 211ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:08,911 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bdbe768f21d7c9573c20547dbbac0f18: 2023-02-12 12:03:08,911 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:08,911 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 12:03:08,917 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/e0ef4e8fae4346d89f7415b83762994f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:08,918 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 92df73bf06fd08e56275a83e22a49358 in 219ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:08,918 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 92df73bf06fd08e56275a83e22a49358: 2023-02-12 12:03:08,919 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:08,919 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 12:03:08,919 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/9f6acd874a4f42809768eaecdf2d94e1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:08,920 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for de503667a307f5dc3ac8248ab10b0543 in 219ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:08,920 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for de503667a307f5dc3ac8248ab10b0543: 2023-02-12 12:03:08,920 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:08,920 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 12:03:08,925 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/e168f340f19e44a29c90db796f8560dd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:08,926 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 72033e60a7bcdebea0d28f7c2147874b in 225ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:08,926 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 72033e60a7bcdebea0d28f7c2147874b: 2023-02-12 12:03:08,926 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:08,926 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 12:03:08,930 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/.tmp/f1/5b67f400fb04412aa687aaf88ef80d5d 2023-02-12 12:03:08,951 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/.tmp/f1/95c3b4a4097f4ddf804ab74b3e38a788 2023-02-12 12:03:08,991 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/.tmp/f2/73ed3c594d4d4f678a217cb71b9e40a9 2023-02-12 12:03:08,999 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/.tmp/f1/5b67f400fb04412aa687aaf88ef80d5d as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/5b67f400fb04412aa687aaf88ef80d5d 2023-02-12 12:03:09,007 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/5b67f400fb04412aa687aaf88ef80d5d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:09,008 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/.tmp/f2/73ed3c594d4d4f678a217cb71b9e40a9 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/73ed3c594d4d4f678a217cb71b9e40a9 2023-02-12 12:03:09,009 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/.tmp/f2/4d679f98f4974652aaacafe2984184bc 2023-02-12 12:03:09,010 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 12:03:09,011 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 12:03:09,016 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/.tmp/f1/95c3b4a4097f4ddf804ab74b3e38a788 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/95c3b4a4097f4ddf804ab74b3e38a788 2023-02-12 12:03:09,018 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/73ed3c594d4d4f678a217cb71b9e40a9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:09,019 INFO [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 78294cc27746b50a7ce4dd4247511391 in 127ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:09,019 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78294cc27746b50a7ce4dd4247511391: 2023-02-12 12:03:09,019 DEBUG [rs(jenkins-hbase4.apache.org,38721,1676203381550)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:09,019 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 12:03:09,019 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 12:03:09,019 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,019 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 12:03:09,020 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38721,1676203381550' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 12:03:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,023 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:09,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:09,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:09,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:09,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38721,1676203381550' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 12:03:09,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ebb6d0f[Count = 1] remaining members to acquire global barrier 2023-02-12 12:03:09,028 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/95c3b4a4097f4ddf804ab74b3e38a788, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:09,029 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/.tmp/f2/4d679f98f4974652aaacafe2984184bc as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/4d679f98f4974652aaacafe2984184bc 2023-02-12 12:03:09,035 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/4d679f98f4974652aaacafe2984184bc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:09,036 INFO [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c5446be50ca61a97be28627a3b4b52c0 in 126ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:09,036 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c5446be50ca61a97be28627a3b4b52c0: 2023-02-12 12:03:09,036 DEBUG [rs(jenkins-hbase4.apache.org,44723,1676203381600)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:09,036 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 12:03:09,036 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 12:03:09,036 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,036 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 12:03:09,037 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44723,1676203381600' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 12:03:09,039 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,039 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:09,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44723,1676203381600' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 12:03:09,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ebb6d0f[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:09,041 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 12:03:09,042 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,049 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,049 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,050 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 12:03:09,050 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,050 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 12:03:09,050 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44723,1676203381600' in zk 2023-02-12 12:03:09,050 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 12:03:09,050 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 12:03:09,050 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38721,1676203381550' in zk 2023-02-12 12:03:09,050 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,050 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:09,053 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 12:03:09,054 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:09,054 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,054 DEBUG [member: 'jenkins-hbase4.apache.org,44723,1676203381600' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 12:03:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:09,056 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,056 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 12:03:09,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:09,056 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:09,056 DEBUG [member: 'jenkins-hbase4.apache.org,38721,1676203381550' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 12:03:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:09,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:09,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44723,1676203381600': 2023-02-12 12:03:09,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44723,1676203381600' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 12:03:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:09,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:09,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:09,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38721,1676203381550': 2023-02-12 12:03:09,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38721,1676203381550' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 12:03:09,064 INFO [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 12:03:09,064 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:09,064 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:09,064 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 12:03:09,064 INFO [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 12:03:09,068 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,068 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,068 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:09,068 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:09,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,068 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:09,068 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:09,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:09,069 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:09,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:09,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,072 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:09,073 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,080 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:09,080 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:09,080 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:09,080 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:09,080 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 12:03:09,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 12:03:09,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:09,080 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:09,080 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:09,080 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:09,080 DEBUG [(jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:09,081 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:09,081 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:09,081 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:09,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:09,082 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:09,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:09,082 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:09,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:09,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:09,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:09,083 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:09,083 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 12:03:09,183 DEBUG [Listener at localhost/35477] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 12:03:09,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 12:03:09,322 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/hadoop-2999789272096489361.jar 2023-02-12 12:03:09,394 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676203386219 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:09,395 DEBUG [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce 2023-02-12 12:03:09,396 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:09,396 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:09,396 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:09,396 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:09,396 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:09,396 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(239): region to add: c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=92df73bf06fd08e56275a83e22a49358 as 92df73bf06fd08e56275a83e22a49358 in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=9f9428638f28b9f7dfb29cdeb2f5c32c as 9f9428638f28b9f7dfb29cdeb2f5c32c in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=374fb48868fc34b353e6550fdfb28075 as 374fb48868fc34b353e6550fdfb28075 in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=75df4fb9fe6b06c7b9a0a55f7f39d525 as 75df4fb9fe6b06c7b9a0a55f7f39d525 in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=bdbe768f21d7c9573c20547dbbac0f18 as bdbe768f21d7c9573c20547dbbac0f18 in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=72033e60a7bcdebea0d28f7c2147874b as 72033e60a7bcdebea0d28f7c2147874b in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=89b0bf71a2f758b674372969fa5b1cd4 as 89b0bf71a2f758b674372969fa5b1cd4 in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,397 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=de503667a307f5dc3ac8248ab10b0543 as de503667a307f5dc3ac8248ab10b0543 in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,398 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=78294cc27746b50a7ce4dd4247511391 as 78294cc27746b50a7ce4dd4247511391 in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,398 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(585): clone region=c5446be50ca61a97be28627a3b4b52c0 as c5446be50ca61a97be28627a3b4b52c0 in snapshot testWithMapReduceMultiRegion 2023-02-12 12:03:09,401 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 75df4fb9fe6b06c7b9a0a55f7f39d525, NAME => 'testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,401 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9f9428638f28b9f7dfb29cdeb2f5c32c, NAME => 'testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,401 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => de503667a307f5dc3ac8248ab10b0543, NAME => 'testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,402 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 374fb48868fc34b353e6550fdfb28075, NAME => 'testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,402 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 72033e60a7bcdebea0d28f7c2147874b, NAME => 'testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,402 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 89b0bf71a2f758b674372969fa5b1cd4, NAME => 'testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,402 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 92df73bf06fd08e56275a83e22a49358, NAME => 'testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,402 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => bdbe768f21d7c9573c20547dbbac0f18, NAME => 'testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,432 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,432 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f00be38737ef470abacb47d4a3c37df9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,445 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4444fa0bd0674053b7b146c452258152 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,452 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,452 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 71d0454f0aa244b88251e93215cab86e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,454 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing bdbe768f21d7c9573c20547dbbac0f18, disabling compactions & flushes 2023-02-12 12:03:09,454 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:09,454 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:09,454 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. after waiting 0 ms 2023-02-12 12:03:09,454 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:09,454 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,454 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:09,454 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9426498cf43447e38f7a57d8ce99ff46 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,454 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for bdbe768f21d7c9573c20547dbbac0f18: Waiting for close lock at 1676203389454Disabling compacts and flushes for region at 1676203389454Disabling writes for close at 1676203389454Writing region close event to WAL at 1676203389454Closed at 1676203389454 2023-02-12 12:03:09,455 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 78294cc27746b50a7ce4dd4247511391, NAME => 'testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,460 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,460 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dbc604bf2f1c41b8882c352d5e16b2ea from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,468 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,468 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 89b0bf71a2f758b674372969fa5b1cd4, disabling compactions & flushes 2023-02-12 12:03:09,468 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:09,469 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:09,469 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. after waiting 0 ms 2023-02-12 12:03:09,469 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:09,469 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:09,469 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 89b0bf71a2f758b674372969fa5b1cd4: Waiting for close lock at 1676203389468Disabling compacts and flushes for region at 1676203389468Disabling writes for close at 1676203389469 (+1 ms)Writing region close event to WAL at 1676203389469Closed at 1676203389469 2023-02-12 12:03:09,469 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a7a19fba8e784a27838952c5f8213598 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,469 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => c5446be50ca61a97be28627a3b4b52c0, NAME => 'testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,476 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7fed9fb8e6674633821b747aaa43c713 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,483 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 374fb48868fc34b353e6550fdfb28075, disabling compactions & flushes 2023-02-12 12:03:09,483 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,483 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:09,484 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cd46b7e5db3146fca6d791c19150b7b0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 75df4fb9fe6b06c7b9a0a55f7f39d525, disabling compactions & flushes 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. after waiting 0 ms 2023-02-12 12:03:09,484 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:09,484 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. after waiting 0 ms 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 374fb48868fc34b353e6550fdfb28075: Waiting for close lock at 1676203389483Disabling compacts and flushes for region at 1676203389483Disabling writes for close at 1676203389484 (+1 ms)Writing region close event to WAL at 1676203389484Closed at 1676203389484 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:09,484 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:09,484 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 75df4fb9fe6b06c7b9a0a55f7f39d525: Waiting for close lock at 1676203389484Disabling compacts and flushes for region at 1676203389484Disabling writes for close at 1676203389484Writing region close event to WAL at 1676203389484Closed at 1676203389484 2023-02-12 12:03:09,491 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 20d4279ecf80453380855f1c671aa3dc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,491 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 9f9428638f28b9f7dfb29cdeb2f5c32c, disabling compactions & flushes 2023-02-12 12:03:09,491 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:09,491 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:09,491 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. after waiting 0 ms 2023-02-12 12:03:09,491 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:09,491 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:09,492 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 9f9428638f28b9f7dfb29cdeb2f5c32c: Waiting for close lock at 1676203389491Disabling compacts and flushes for region at 1676203389491Disabling writes for close at 1676203389491Writing region close event to WAL at 1676203389491Closed at 1676203389491 2023-02-12 12:03:09,492 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,492 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5c26a7407cad45c39e68f0363cc2341a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,496 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3701d3d94ebb4e4d954fbd1068bc75dc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,496 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,496 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 48b7f152442740babd74aa4a678c363e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,497 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 097a66d9d8264f12990db38cb221a5f2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,497 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing de503667a307f5dc3ac8248ab10b0543, disabling compactions & flushes 2023-02-12 12:03:09,497 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:09,497 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:09,497 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. after waiting 0 ms 2023-02-12 12:03:09,497 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:09,497 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:09,497 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for de503667a307f5dc3ac8248ab10b0543: Waiting for close lock at 1676203389497Disabling compacts and flushes for region at 1676203389497Disabling writes for close at 1676203389497Writing region close event to WAL at 1676203389497Closed at 1676203389497 2023-02-12 12:03:09,504 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 92df73bf06fd08e56275a83e22a49358, disabling compactions & flushes 2023-02-12 12:03:09,504 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:09,504 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:09,504 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e92c83cb764241269c70bec13c7c9138 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,504 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 342c7e47f75b4d8192f6e8fcd57b3fdc from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,504 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:09,504 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. after waiting 0 ms 2023-02-12 12:03:09,504 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:09,505 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:09,505 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 92df73bf06fd08e56275a83e22a49358: Waiting for close lock at 1676203389504Disabling compacts and flushes for region at 1676203389504Disabling writes for close at 1676203389504Writing region close event to WAL at 1676203389505 (+1 ms)Closed at 1676203389505 2023-02-12 12:03:09,505 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 72033e60a7bcdebea0d28f7c2147874b, disabling compactions & flushes 2023-02-12 12:03:09,505 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:09,505 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:09,506 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. after waiting 0 ms 2023-02-12 12:03:09,506 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:09,506 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:09,506 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 72033e60a7bcdebea0d28f7c2147874b: Waiting for close lock at 1676203389505Disabling compacts and flushes for region at 1676203389505Disabling writes for close at 1676203389506 (+1 ms)Writing region close event to WAL at 1676203389506Closed at 1676203389506 2023-02-12 12:03:09,507 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 78294cc27746b50a7ce4dd4247511391, disabling compactions & flushes 2023-02-12 12:03:09,507 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:09,507 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:09,507 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. after waiting 0 ms 2023-02-12 12:03:09,507 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:09,507 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:09,507 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 78294cc27746b50a7ce4dd4247511391: Waiting for close lock at 1676203389507Disabling compacts and flushes for region at 1676203389507Disabling writes for close at 1676203389507Writing region close event to WAL at 1676203389507Closed at 1676203389507 2023-02-12 12:03:09,507 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 68377fb0efa24dfbadc8a96d51a387ed from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 12:03:09,509 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing c5446be50ca61a97be28627a3b4b52c0, disabling compactions & flushes 2023-02-12 12:03:09,509 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:09,509 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:09,509 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. after waiting 0 ms 2023-02-12 12:03:09,509 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:09,509 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:09,510 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for c5446be50ca61a97be28627a3b4b52c0: Waiting for close lock at 1676203389509Disabling compacts and flushes for region at 1676203389509Disabling writes for close at 1676203389509Writing region close event to WAL at 1676203389509Closed at 1676203389509 2023-02-12 12:03:09,510 INFO [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676203386219 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:09,510 DEBUG [Listener at localhost/35477] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,510 DEBUG [Listener at localhost/35477] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53 2023-02-12 12:03:09,511 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-data/ 2023-02-12 12:03:09,512 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----default/ 2023-02-12 12:03:09,512 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 12:03:09,513 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------374fb48868fc34b353e6550fdfb28075/ 2023-02-12 12:03:09,513 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,514 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:09,514 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=374fb48868fc34b353e6550fdfb28075-9426498cf43447e38f7a57d8ce99ff46 2023-02-12 12:03:09,514 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:09,515 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=374fb48868fc34b353e6550fdfb28075-a7a19fba8e784a27838952c5f8213598 2023-02-12 12:03:09,515 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------72033e60a7bcdebea0d28f7c2147874b/ 2023-02-12 12:03:09,515 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,515 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:09,516 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=72033e60a7bcdebea0d28f7c2147874b-5c26a7407cad45c39e68f0363cc2341a 2023-02-12 12:03:09,516 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:09,516 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=72033e60a7bcdebea0d28f7c2147874b-097a66d9d8264f12990db38cb221a5f2 2023-02-12 12:03:09,516 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------75df4fb9fe6b06c7b9a0a55f7f39d525/ 2023-02-12 12:03:09,517 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,517 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------78294cc27746b50a7ce4dd4247511391/ 2023-02-12 12:03:09,518 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,518 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:09,518 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=78294cc27746b50a7ce4dd4247511391-48b7f152442740babd74aa4a678c363e 2023-02-12 12:03:09,518 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:09,519 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=78294cc27746b50a7ce4dd4247511391-e92c83cb764241269c70bec13c7c9138 2023-02-12 12:03:09,519 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------89b0bf71a2f758b674372969fa5b1cd4/ 2023-02-12 12:03:09,519 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,519 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------92df73bf06fd08e56275a83e22a49358/ 2023-02-12 12:03:09,520 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,520 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:09,521 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=92df73bf06fd08e56275a83e22a49358-cd46b7e5db3146fca6d791c19150b7b0 2023-02-12 12:03:09,521 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:09,521 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=92df73bf06fd08e56275a83e22a49358-3701d3d94ebb4e4d954fbd1068bc75dc 2023-02-12 12:03:09,521 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------9f9428638f28b9f7dfb29cdeb2f5c32c/ 2023-02-12 12:03:09,522 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,522 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:09,522 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=9f9428638f28b9f7dfb29cdeb2f5c32c-71d0454f0aa244b88251e93215cab86e 2023-02-12 12:03:09,522 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:09,523 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=9f9428638f28b9f7dfb29cdeb2f5c32c-7fed9fb8e6674633821b747aaa43c713 2023-02-12 12:03:09,523 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------bdbe768f21d7c9573c20547dbbac0f18/ 2023-02-12 12:03:09,523 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,524 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:09,524 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=bdbe768f21d7c9573c20547dbbac0f18-f00be38737ef470abacb47d4a3c37df9 2023-02-12 12:03:09,524 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:09,525 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=bdbe768f21d7c9573c20547dbbac0f18-4444fa0bd0674053b7b146c452258152 2023-02-12 12:03:09,525 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------c5446be50ca61a97be28627a3b4b52c0/ 2023-02-12 12:03:09,525 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,525 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:09,526 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=c5446be50ca61a97be28627a3b4b52c0-342c7e47f75b4d8192f6e8fcd57b3fdc 2023-02-12 12:03:09,526 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:09,526 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=c5446be50ca61a97be28627a3b4b52c0-68377fb0efa24dfbadc8a96d51a387ed 2023-02-12 12:03:09,526 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |----------de503667a307f5dc3ac8248ab10b0543/ 2023-02-12 12:03:09,527 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:09,527 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:09,528 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=de503667a307f5dc3ac8248ab10b0543-dbc604bf2f1c41b8882c352d5e16b2ea 2023-02-12 12:03:09,528 DEBUG [Listener at localhost/35477] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:09,528 DEBUG [Listener at localhost/35477] util.CommonFSUtils(702): |----------------testWithMapReduce=de503667a307f5dc3ac8248ab10b0543-20d4279ecf80453380855f1c671aa3dc 2023-02-12 12:03:09,536 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,536 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,536 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,537 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,537 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,538 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,538 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,607 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/hadoop-5403061136697243466.jar 2023-02-12 12:03:09,607 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,608 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,608 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,608 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,609 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,609 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,610 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 12:03:09,611 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 12:03:09,611 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 12:03:09,611 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 12:03:09,612 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 12:03:09,613 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 12:03:09,613 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 12:03:09,614 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 12:03:09,614 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 12:03:09,615 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 12:03:09,621 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:09,621 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 12:03:09,621 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 12:03:09,622 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 12:03:09,622 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 12:03:09,688 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/hadoop-919365597127090581.jar 2023-02-12 12:03:09,689 DEBUG [Listener at localhost/35477] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 12:03:09,736 WARN [Listener at localhost/35477] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 12:03:09,792 INFO [Listener at localhost/35477] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 12:03:10,123 WARN [Listener at localhost/35477] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/mapreduce.cluster.local.dir/1676203390032/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 12:03:10,123 WARN [Listener at localhost/35477] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/mapreduce.cluster.local.dir/1676203390032/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 12:03:10,285 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:10,285 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:10,288 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:10,291 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:10,292 DEBUG [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1 2023-02-12 12:03:10,292 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 374fb48868fc34b353e6550fdfb28075 columnFamilyName f1 2023-02-12 12:03:10,301 DEBUG [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/testWithMapReduce=374fb48868fc34b353e6550fdfb28075-9426498cf43447e38f7a57d8ce99ff46 2023-02-12 12:03:10,301 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(310): Store=374fb48868fc34b353e6550fdfb28075/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,301 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:10,302 DEBUG [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2 2023-02-12 12:03:10,303 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 374fb48868fc34b353e6550fdfb28075 columnFamilyName f2 2023-02-12 12:03:10,308 DEBUG [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/testWithMapReduce=374fb48868fc34b353e6550fdfb28075-a7a19fba8e784a27838952c5f8213598 2023-02-12 12:03:10,309 INFO [StoreOpener-374fb48868fc34b353e6550fdfb28075-1] regionserver.HStore(310): Store=374fb48868fc34b353e6550fdfb28075/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,309 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:10,309 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 374fb48868fc34b353e6550fdfb28075; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74054762, jitterRate=0.10350194573402405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:10,309 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 374fb48868fc34b353e6550fdfb28075: Writing region info on filesystem at 1676203390288Initializing all the Stores at 1676203390289 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390289Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390290 (+1 ms)Region opened successfully at 1676203390309 (+19 ms) 2023-02-12 12:03:10,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 374fb48868fc34b353e6550fdfb28075, disabling compactions & flushes 2023-02-12 12:03:10,440 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:10,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:10,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. after waiting 0 ms 2023-02-12 12:03:10,440 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:10,444 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:10,444 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 374fb48868fc34b353e6550fdfb28075: Waiting for close lock at 1676203390440Disabling compacts and flushes for region at 1676203390440Disabling writes for close at 1676203390440Writing region close event to WAL at 1676203390444 (+4 ms)Closed at 1676203390444 2023-02-12 12:03:10,458 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:10,458 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:10,459 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:10,464 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:10,465 DEBUG [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1 2023-02-12 12:03:10,466 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78294cc27746b50a7ce4dd4247511391 columnFamilyName f1 2023-02-12 12:03:10,472 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:10,473 DEBUG [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/testWithMapReduce=78294cc27746b50a7ce4dd4247511391-48b7f152442740babd74aa4a678c363e 2023-02-12 12:03:10,473 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 12:03:10,473 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(310): Store=78294cc27746b50a7ce4dd4247511391/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,473 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:10,474 DEBUG [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2 2023-02-12 12:03:10,475 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78294cc27746b50a7ce4dd4247511391 columnFamilyName f2 2023-02-12 12:03:10,481 DEBUG [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/testWithMapReduce=78294cc27746b50a7ce4dd4247511391-e92c83cb764241269c70bec13c7c9138 2023-02-12 12:03:10,481 INFO [StoreOpener-78294cc27746b50a7ce4dd4247511391-1] regionserver.HStore(310): Store=78294cc27746b50a7ce4dd4247511391/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,482 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:10,482 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 78294cc27746b50a7ce4dd4247511391; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62522597, jitterRate=-0.06834070384502411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:10,482 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 78294cc27746b50a7ce4dd4247511391: Writing region info on filesystem at 1676203390459Initializing all the Stores at 1676203390461 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390461Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390463 (+2 ms)Region opened successfully at 1676203390482 (+19 ms) 2023-02-12 12:03:10,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 78294cc27746b50a7ce4dd4247511391, disabling compactions & flushes 2023-02-12 12:03:10,550 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:10,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:10,551 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. after waiting 0 ms 2023-02-12 12:03:10,551 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:10,556 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:10,556 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 78294cc27746b50a7ce4dd4247511391: Waiting for close lock at 1676203390550Disabling compacts and flushes for region at 1676203390550Disabling writes for close at 1676203390551 (+1 ms)Writing region close event to WAL at 1676203390556 (+5 ms)Closed at 1676203390556 2023-02-12 12:03:10,562 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:10,562 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:10,565 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:10,567 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:10,569 DEBUG [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/f1 2023-02-12 12:03:10,570 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75df4fb9fe6b06c7b9a0a55f7f39d525 columnFamilyName f1 2023-02-12 12:03:10,571 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] regionserver.HStore(310): Store=75df4fb9fe6b06c7b9a0a55f7f39d525/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,571 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:10,572 DEBUG [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/f2 2023-02-12 12:03:10,573 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75df4fb9fe6b06c7b9a0a55f7f39d525 columnFamilyName f2 2023-02-12 12:03:10,574 INFO [StoreOpener-75df4fb9fe6b06c7b9a0a55f7f39d525-1] regionserver.HStore(310): Store=75df4fb9fe6b06c7b9a0a55f7f39d525/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,574 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:10,574 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 75df4fb9fe6b06c7b9a0a55f7f39d525; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59225641, jitterRate=-0.1174691766500473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:10,574 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 75df4fb9fe6b06c7b9a0a55f7f39d525: Writing region info on filesystem at 1676203390565Initializing all the Stores at 1676203390566 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390566Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390567 (+1 ms)Region opened successfully at 1676203390574 (+7 ms) 2023-02-12 12:03:10,622 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 75df4fb9fe6b06c7b9a0a55f7f39d525, disabling compactions & flushes 2023-02-12 12:03:10,622 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:10,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:10,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. after waiting 0 ms 2023-02-12 12:03:10,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:10,623 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:10,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 75df4fb9fe6b06c7b9a0a55f7f39d525: Waiting for close lock at 1676203390622Disabling compacts and flushes for region at 1676203390622Disabling writes for close at 1676203390623 (+1 ms)Writing region close event to WAL at 1676203390623Closed at 1676203390623 2023-02-12 12:03:10,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:10,629 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:10,630 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:10,632 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:10,634 DEBUG [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1 2023-02-12 12:03:10,634 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72033e60a7bcdebea0d28f7c2147874b columnFamilyName f1 2023-02-12 12:03:10,642 DEBUG [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/testWithMapReduce=72033e60a7bcdebea0d28f7c2147874b-5c26a7407cad45c39e68f0363cc2341a 2023-02-12 12:03:10,642 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(310): Store=72033e60a7bcdebea0d28f7c2147874b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,642 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:10,643 DEBUG [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2 2023-02-12 12:03:10,643 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72033e60a7bcdebea0d28f7c2147874b columnFamilyName f2 2023-02-12 12:03:10,654 DEBUG [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/testWithMapReduce=72033e60a7bcdebea0d28f7c2147874b-097a66d9d8264f12990db38cb221a5f2 2023-02-12 12:03:10,655 INFO [StoreOpener-72033e60a7bcdebea0d28f7c2147874b-1] regionserver.HStore(310): Store=72033e60a7bcdebea0d28f7c2147874b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:10,655 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 72033e60a7bcdebea0d28f7c2147874b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65794288, jitterRate=-0.019588708877563477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:10,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 72033e60a7bcdebea0d28f7c2147874b: Writing region info on filesystem at 1676203390630Initializing all the Stores at 1676203390632 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390632Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390632Region opened successfully at 1676203390655 (+23 ms) 2023-02-12 12:03:10,709 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 72033e60a7bcdebea0d28f7c2147874b, disabling compactions & flushes 2023-02-12 12:03:10,709 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:10,710 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:10,710 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. after waiting 0 ms 2023-02-12 12:03:10,710 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:10,713 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:10,713 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 72033e60a7bcdebea0d28f7c2147874b: Waiting for close lock at 1676203390709Disabling compacts and flushes for region at 1676203390709Disabling writes for close at 1676203390710 (+1 ms)Writing region close event to WAL at 1676203390713 (+3 ms)Closed at 1676203390713 2023-02-12 12:03:10,718 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:10,718 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:10,720 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:10,722 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:10,724 DEBUG [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/f1 2023-02-12 12:03:10,724 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89b0bf71a2f758b674372969fa5b1cd4 columnFamilyName f1 2023-02-12 12:03:10,725 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] regionserver.HStore(310): Store=89b0bf71a2f758b674372969fa5b1cd4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,725 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:10,727 DEBUG [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/f2 2023-02-12 12:03:10,727 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89b0bf71a2f758b674372969fa5b1cd4 columnFamilyName f2 2023-02-12 12:03:10,728 INFO [StoreOpener-89b0bf71a2f758b674372969fa5b1cd4-1] regionserver.HStore(310): Store=89b0bf71a2f758b674372969fa5b1cd4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,728 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:10,728 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 89b0bf71a2f758b674372969fa5b1cd4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69125813, jitterRate=0.030054882168769836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:10,728 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 89b0bf71a2f758b674372969fa5b1cd4: Writing region info on filesystem at 1676203390721Initializing all the Stores at 1676203390722 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390722Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390722Region opened successfully at 1676203390728 (+6 ms) 2023-02-12 12:03:10,747 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 89b0bf71a2f758b674372969fa5b1cd4, disabling compactions & flushes 2023-02-12 12:03:10,747 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:10,747 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:10,747 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. after waiting 0 ms 2023-02-12 12:03:10,747 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:10,748 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:10,748 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 89b0bf71a2f758b674372969fa5b1cd4: Waiting for close lock at 1676203390747Disabling compacts and flushes for region at 1676203390747Disabling writes for close at 1676203390747Writing region close event to WAL at 1676203390748 (+1 ms)Closed at 1676203390748 2023-02-12 12:03:10,755 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:10,755 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:10,756 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:10,760 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:10,762 DEBUG [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1 2023-02-12 12:03:10,762 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92df73bf06fd08e56275a83e22a49358 columnFamilyName f1 2023-02-12 12:03:10,769 DEBUG [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/testWithMapReduce=92df73bf06fd08e56275a83e22a49358-cd46b7e5db3146fca6d791c19150b7b0 2023-02-12 12:03:10,769 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(310): Store=92df73bf06fd08e56275a83e22a49358/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,770 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:10,771 DEBUG [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2 2023-02-12 12:03:10,771 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92df73bf06fd08e56275a83e22a49358 columnFamilyName f2 2023-02-12 12:03:10,782 DEBUG [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/testWithMapReduce=92df73bf06fd08e56275a83e22a49358-3701d3d94ebb4e4d954fbd1068bc75dc 2023-02-12 12:03:10,782 INFO [StoreOpener-92df73bf06fd08e56275a83e22a49358-1] regionserver.HStore(310): Store=92df73bf06fd08e56275a83e22a49358/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:10,782 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 92df73bf06fd08e56275a83e22a49358; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59873158, jitterRate=-0.10782042145729065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:10,782 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 92df73bf06fd08e56275a83e22a49358: Writing region info on filesystem at 1676203390756Initializing all the Stores at 1676203390757 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390757Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390760 (+3 ms)Region opened successfully at 1676203390782 (+22 ms) 2023-02-12 12:03:10,845 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 92df73bf06fd08e56275a83e22a49358, disabling compactions & flushes 2023-02-12 12:03:10,846 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:10,846 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:10,846 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. after waiting 0 ms 2023-02-12 12:03:10,846 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:10,849 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:10,849 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 92df73bf06fd08e56275a83e22a49358: Waiting for close lock at 1676203390845Disabling compacts and flushes for region at 1676203390845Disabling writes for close at 1676203390846 (+1 ms)Writing region close event to WAL at 1676203390849 (+3 ms)Closed at 1676203390849 2023-02-12 12:03:10,855 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:10,855 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:10,856 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:10,858 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:10,859 DEBUG [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1 2023-02-12 12:03:10,860 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f9428638f28b9f7dfb29cdeb2f5c32c columnFamilyName f1 2023-02-12 12:03:10,868 DEBUG [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/testWithMapReduce=9f9428638f28b9f7dfb29cdeb2f5c32c-71d0454f0aa244b88251e93215cab86e 2023-02-12 12:03:10,868 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(310): Store=9f9428638f28b9f7dfb29cdeb2f5c32c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,868 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:10,869 DEBUG [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2 2023-02-12 12:03:10,870 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f9428638f28b9f7dfb29cdeb2f5c32c columnFamilyName f2 2023-02-12 12:03:10,876 DEBUG [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/testWithMapReduce=9f9428638f28b9f7dfb29cdeb2f5c32c-7fed9fb8e6674633821b747aaa43c713 2023-02-12 12:03:10,876 INFO [StoreOpener-9f9428638f28b9f7dfb29cdeb2f5c32c-1] regionserver.HStore(310): Store=9f9428638f28b9f7dfb29cdeb2f5c32c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:10,877 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9f9428638f28b9f7dfb29cdeb2f5c32c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59358895, jitterRate=-0.11548353731632233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:10,877 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9f9428638f28b9f7dfb29cdeb2f5c32c: Writing region info on filesystem at 1676203390856Initializing all the Stores at 1676203390858 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390858Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390858Region opened successfully at 1676203390877 (+19 ms) 2023-02-12 12:03:10,946 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9f9428638f28b9f7dfb29cdeb2f5c32c, disabling compactions & flushes 2023-02-12 12:03:10,946 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:10,947 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:10,947 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. after waiting 0 ms 2023-02-12 12:03:10,947 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:10,951 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:10,951 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9f9428638f28b9f7dfb29cdeb2f5c32c: Waiting for close lock at 1676203390946Disabling compacts and flushes for region at 1676203390946Disabling writes for close at 1676203390947 (+1 ms)Writing region close event to WAL at 1676203390951 (+4 ms)Closed at 1676203390951 2023-02-12 12:03:10,957 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:10,957 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:10,960 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:10,963 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:10,964 DEBUG [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1 2023-02-12 12:03:10,964 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5446be50ca61a97be28627a3b4b52c0 columnFamilyName f1 2023-02-12 12:03:10,971 DEBUG [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/testWithMapReduce=c5446be50ca61a97be28627a3b4b52c0-342c7e47f75b4d8192f6e8fcd57b3fdc 2023-02-12 12:03:10,971 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(310): Store=c5446be50ca61a97be28627a3b4b52c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,971 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:10,972 DEBUG [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2 2023-02-12 12:03:10,973 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5446be50ca61a97be28627a3b4b52c0 columnFamilyName f2 2023-02-12 12:03:10,980 DEBUG [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/testWithMapReduce=c5446be50ca61a97be28627a3b4b52c0-68377fb0efa24dfbadc8a96d51a387ed 2023-02-12 12:03:10,980 INFO [StoreOpener-c5446be50ca61a97be28627a3b4b52c0-1] regionserver.HStore(310): Store=c5446be50ca61a97be28627a3b4b52c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:10,980 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:10,980 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c5446be50ca61a97be28627a3b4b52c0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62756864, jitterRate=-0.064849853515625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:10,981 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c5446be50ca61a97be28627a3b4b52c0: Writing region info on filesystem at 1676203390960Initializing all the Stores at 1676203390961 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390961Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203390962 (+1 ms)Region opened successfully at 1676203390980 (+18 ms) 2023-02-12 12:03:11,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c5446be50ca61a97be28627a3b4b52c0, disabling compactions & flushes 2023-02-12 12:03:11,024 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:11,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:11,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. after waiting 0 ms 2023-02-12 12:03:11,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:11,027 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:11,027 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c5446be50ca61a97be28627a3b4b52c0: Waiting for close lock at 1676203391024Disabling compacts and flushes for region at 1676203391024Disabling writes for close at 1676203391024Writing region close event to WAL at 1676203391027 (+3 ms)Closed at 1676203391027 2023-02-12 12:03:11,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:11,032 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:11,035 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:11,037 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:11,038 DEBUG [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1 2023-02-12 12:03:11,039 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de503667a307f5dc3ac8248ab10b0543 columnFamilyName f1 2023-02-12 12:03:11,052 DEBUG [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/testWithMapReduce=de503667a307f5dc3ac8248ab10b0543-dbc604bf2f1c41b8882c352d5e16b2ea 2023-02-12 12:03:11,052 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(310): Store=de503667a307f5dc3ac8248ab10b0543/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:11,052 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:11,054 DEBUG [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2 2023-02-12 12:03:11,054 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de503667a307f5dc3ac8248ab10b0543 columnFamilyName f2 2023-02-12 12:03:11,061 DEBUG [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/testWithMapReduce=de503667a307f5dc3ac8248ab10b0543-20d4279ecf80453380855f1c671aa3dc 2023-02-12 12:03:11,061 INFO [StoreOpener-de503667a307f5dc3ac8248ab10b0543-1] regionserver.HStore(310): Store=de503667a307f5dc3ac8248ab10b0543/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:11,062 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:11,062 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened de503667a307f5dc3ac8248ab10b0543; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63855903, jitterRate=-0.048472896218299866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:11,062 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for de503667a307f5dc3ac8248ab10b0543: Writing region info on filesystem at 1676203391035Initializing all the Stores at 1676203391036 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203391036Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203391037 (+1 ms)Region opened successfully at 1676203391062 (+25 ms) 2023-02-12 12:03:11,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing de503667a307f5dc3ac8248ab10b0543, disabling compactions & flushes 2023-02-12 12:03:11,098 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:11,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:11,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. after waiting 0 ms 2023-02-12 12:03:11,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:11,101 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:11,101 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for de503667a307f5dc3ac8248ab10b0543: Waiting for close lock at 1676203391098Disabling compacts and flushes for region at 1676203391098Disabling writes for close at 1676203391098Writing region close event to WAL at 1676203391101 (+3 ms)Closed at 1676203391101 2023-02-12 12:03:11,105 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:11,106 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:11,107 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:11,110 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:11,111 DEBUG [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1 2023-02-12 12:03:11,111 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdbe768f21d7c9573c20547dbbac0f18 columnFamilyName f1 2023-02-12 12:03:11,118 DEBUG [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/testWithMapReduce=bdbe768f21d7c9573c20547dbbac0f18-f00be38737ef470abacb47d4a3c37df9 2023-02-12 12:03:11,118 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(310): Store=bdbe768f21d7c9573c20547dbbac0f18/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:11,118 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:11,120 DEBUG [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2 2023-02-12 12:03:11,120 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdbe768f21d7c9573c20547dbbac0f18 columnFamilyName f2 2023-02-12 12:03:11,126 DEBUG [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(539): loaded hdfs://localhost:41375/user/jenkins/test-data/9893f72f-8fae-2967-e327-89a62efedaeb/testWithMapReduceMultiRegion/d20e98c6-393b-4f62-9149-573b335c3a53/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/testWithMapReduce=bdbe768f21d7c9573c20547dbbac0f18-4444fa0bd0674053b7b146c452258152 2023-02-12 12:03:11,126 INFO [StoreOpener-bdbe768f21d7c9573c20547dbbac0f18-1] regionserver.HStore(310): Store=bdbe768f21d7c9573c20547dbbac0f18/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:11,126 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:11,126 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bdbe768f21d7c9573c20547dbbac0f18; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65029831, jitterRate=-0.030980005860328674}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:11,126 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bdbe768f21d7c9573c20547dbbac0f18: Writing region info on filesystem at 1676203391108Initializing all the Stores at 1676203391109 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203391109Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203391109Region opened successfully at 1676203391126 (+17 ms) 2023-02-12 12:03:11,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bdbe768f21d7c9573c20547dbbac0f18, disabling compactions & flushes 2023-02-12 12:03:11,158 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:11,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:11,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. after waiting 0 ms 2023-02-12 12:03:11,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:11,161 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:11,161 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bdbe768f21d7c9573c20547dbbac0f18: Waiting for close lock at 1676203391158Disabling compacts and flushes for region at 1676203391158Disabling writes for close at 1676203391158Writing region close event to WAL at 1676203391161 (+3 ms)Closed at 1676203391161 2023-02-12 12:03:12,217 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-12 12:03:12,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-12 12:03:12,224 INFO [Listener at localhost/35477] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 12:03:12,224 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 12:03:12,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 12:03:12,237 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203392237"}]},"ts":"1676203392237"} 2023-02-12 12:03:12,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 12:03:12,239 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 12:03:12,242 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 12:03:12,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=75df4fb9fe6b06c7b9a0a55f7f39d525, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bdbe768f21d7c9573c20547dbbac0f18, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=72033e60a7bcdebea0d28f7c2147874b, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=78294cc27746b50a7ce4dd4247511391, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c5446be50ca61a97be28627a3b4b52c0, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=92df73bf06fd08e56275a83e22a49358, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=de503667a307f5dc3ac8248ab10b0543, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9f9428638f28b9f7dfb29cdeb2f5c32c, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=374fb48868fc34b353e6550fdfb28075, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=89b0bf71a2f758b674372969fa5b1cd4, UNASSIGN}] 2023-02-12 12:03:12,248 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c5446be50ca61a97be28627a3b4b52c0, UNASSIGN 2023-02-12 12:03:12,249 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=78294cc27746b50a7ce4dd4247511391, UNASSIGN 2023-02-12 12:03:12,249 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=72033e60a7bcdebea0d28f7c2147874b, UNASSIGN 2023-02-12 12:03:12,250 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=89b0bf71a2f758b674372969fa5b1cd4, UNASSIGN 2023-02-12 12:03:12,250 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=92df73bf06fd08e56275a83e22a49358, UNASSIGN 2023-02-12 12:03:12,251 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c5446be50ca61a97be28627a3b4b52c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:12,251 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392250"}]},"ts":"1676203392250"} 2023-02-12 12:03:12,251 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=72033e60a7bcdebea0d28f7c2147874b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:12,251 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=78294cc27746b50a7ce4dd4247511391, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:12,251 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392251"}]},"ts":"1676203392251"} 2023-02-12 12:03:12,251 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=92df73bf06fd08e56275a83e22a49358, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:12,252 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392251"}]},"ts":"1676203392251"} 2023-02-12 12:03:12,251 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392251"}]},"ts":"1676203392251"} 2023-02-12 12:03:12,251 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=89b0bf71a2f758b674372969fa5b1cd4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:12,252 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203392251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392251"}]},"ts":"1676203392251"} 2023-02-12 12:03:12,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=38, state=RUNNABLE; CloseRegionProcedure c5446be50ca61a97be28627a3b4b52c0, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:12,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=37, state=RUNNABLE; CloseRegionProcedure 78294cc27746b50a7ce4dd4247511391, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:12,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure 92df73bf06fd08e56275a83e22a49358, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:12,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=36, state=RUNNABLE; CloseRegionProcedure 72033e60a7bcdebea0d28f7c2147874b, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:12,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 89b0bf71a2f758b674372969fa5b1cd4, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:12,266 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=374fb48868fc34b353e6550fdfb28075, UNASSIGN 2023-02-12 12:03:12,266 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9f9428638f28b9f7dfb29cdeb2f5c32c, UNASSIGN 2023-02-12 12:03:12,267 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=de503667a307f5dc3ac8248ab10b0543, UNASSIGN 2023-02-12 12:03:12,267 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bdbe768f21d7c9573c20547dbbac0f18, UNASSIGN 2023-02-12 12:03:12,268 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=374fb48868fc34b353e6550fdfb28075, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:12,268 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=de503667a307f5dc3ac8248ab10b0543, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:12,268 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392268"}]},"ts":"1676203392268"} 2023-02-12 12:03:12,268 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9f9428638f28b9f7dfb29cdeb2f5c32c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:12,268 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=bdbe768f21d7c9573c20547dbbac0f18, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:12,268 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392268"}]},"ts":"1676203392268"} 2023-02-12 12:03:12,268 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392268"}]},"ts":"1676203392268"} 2023-02-12 12:03:12,268 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392268"}]},"ts":"1676203392268"} 2023-02-12 12:03:12,269 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=75df4fb9fe6b06c7b9a0a55f7f39d525, UNASSIGN 2023-02-12 12:03:12,270 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=75df4fb9fe6b06c7b9a0a55f7f39d525, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:12,270 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203392270"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203392270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203392270"}]},"ts":"1676203392270"} 2023-02-12 12:03:12,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 374fb48868fc34b353e6550fdfb28075, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:12,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=40, state=RUNNABLE; CloseRegionProcedure de503667a307f5dc3ac8248ab10b0543, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:12,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=41, state=RUNNABLE; CloseRegionProcedure 9f9428638f28b9f7dfb29cdeb2f5c32c, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:12,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure bdbe768f21d7c9573c20547dbbac0f18, server=jenkins-hbase4.apache.org,44723,1676203381600}] 2023-02-12 12:03:12,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 75df4fb9fe6b06c7b9a0a55f7f39d525, server=jenkins-hbase4.apache.org,38721,1676203381550}] 2023-02-12 12:03:12,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 12:03:12,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:12,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 72033e60a7bcdebea0d28f7c2147874b, disabling compactions & flushes 2023-02-12 12:03:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 92df73bf06fd08e56275a83e22a49358, disabling compactions & flushes 2023-02-12 12:03:12,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:12,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. after waiting 0 ms 2023-02-12 12:03:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. after waiting 0 ms 2023-02-12 12:03:12,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:12,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:12,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b. 2023-02-12 12:03:12,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 72033e60a7bcdebea0d28f7c2147874b: Waiting for close lock at 1676203392416Running coprocessor pre-close hooks at 1676203392416Disabling compacts and flushes for region at 1676203392416Disabling writes for close at 1676203392416Writing region close event to WAL at 1676203392425 (+9 ms)Running coprocessor post-close hooks at 1676203392430 (+5 ms)Closed at 1676203392430 2023-02-12 12:03:12,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:12,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358. 2023-02-12 12:03:12,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 92df73bf06fd08e56275a83e22a49358: Waiting for close lock at 1676203392416Running coprocessor pre-close hooks at 1676203392416Disabling compacts and flushes for region at 1676203392416Disabling writes for close at 1676203392416Writing region close event to WAL at 1676203392425 (+9 ms)Running coprocessor post-close hooks at 1676203392432 (+7 ms)Closed at 1676203392433 (+1 ms) 2023-02-12 12:03:12,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:12,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:12,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 374fb48868fc34b353e6550fdfb28075, disabling compactions & flushes 2023-02-12 12:03:12,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:12,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:12,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. after waiting 0 ms 2023-02-12 12:03:12,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:12,434 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=72033e60a7bcdebea0d28f7c2147874b, regionState=CLOSED 2023-02-12 12:03:12,434 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392434"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392434"}]},"ts":"1676203392434"} 2023-02-12 12:03:12,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:12,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:12,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bdbe768f21d7c9573c20547dbbac0f18, disabling compactions & flushes 2023-02-12 12:03:12,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:12,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:12,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. after waiting 0 ms 2023-02-12 12:03:12,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:12,439 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=92df73bf06fd08e56275a83e22a49358, regionState=CLOSED 2023-02-12 12:03:12,439 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392438"}]},"ts":"1676203392438"} 2023-02-12 12:03:12,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=36 2023-02-12 12:03:12,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-12 12:03:12,448 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure 92df73bf06fd08e56275a83e22a49358, server=jenkins-hbase4.apache.org,44723,1676203381600 in 187 msec 2023-02-12 12:03:12,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=72033e60a7bcdebea0d28f7c2147874b, UNASSIGN in 203 msec 2023-02-12 12:03:12,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=36, state=SUCCESS; CloseRegionProcedure 72033e60a7bcdebea0d28f7c2147874b, server=jenkins-hbase4.apache.org,38721,1676203381550 in 181 msec 2023-02-12 12:03:12,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:12,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075. 2023-02-12 12:03:12,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 374fb48868fc34b353e6550fdfb28075: Waiting for close lock at 1676203392433Running coprocessor pre-close hooks at 1676203392434 (+1 ms)Disabling compacts and flushes for region at 1676203392434Disabling writes for close at 1676203392434Writing region close event to WAL at 1676203392437 (+3 ms)Running coprocessor post-close hooks at 1676203392453 (+16 ms)Closed at 1676203392456 (+3 ms) 2023-02-12 12:03:12,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=92df73bf06fd08e56275a83e22a49358, UNASSIGN in 205 msec 2023-02-12 12:03:12,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:12,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:12,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 75df4fb9fe6b06c7b9a0a55f7f39d525, disabling compactions & flushes 2023-02-12 12:03:12,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:12,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:12,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. after waiting 0 ms 2023-02-12 12:03:12,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:12,460 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=374fb48868fc34b353e6550fdfb28075, regionState=CLOSED 2023-02-12 12:03:12,460 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392459"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392459"}]},"ts":"1676203392459"} 2023-02-12 12:03:12,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-12 12:03:12,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 374fb48868fc34b353e6550fdfb28075, server=jenkins-hbase4.apache.org,38721,1676203381550 in 191 msec 2023-02-12 12:03:12,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=374fb48868fc34b353e6550fdfb28075, UNASSIGN in 220 msec 2023-02-12 12:03:12,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:12,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18. 2023-02-12 12:03:12,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bdbe768f21d7c9573c20547dbbac0f18: Waiting for close lock at 1676203392437Running coprocessor pre-close hooks at 1676203392437Disabling compacts and flushes for region at 1676203392437Disabling writes for close at 1676203392437Writing region close event to WAL at 1676203392448 (+11 ms)Running coprocessor post-close hooks at 1676203392473 (+25 ms)Closed at 1676203392474 (+1 ms) 2023-02-12 12:03:12,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:12,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:12,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c5446be50ca61a97be28627a3b4b52c0, disabling compactions & flushes 2023-02-12 12:03:12,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:12,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:12,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. after waiting 0 ms 2023-02-12 12:03:12,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:12,477 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=bdbe768f21d7c9573c20547dbbac0f18, regionState=CLOSED 2023-02-12 12:03:12,477 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392477"}]},"ts":"1676203392477"} 2023-02-12 12:03:12,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-12 12:03:12,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure bdbe768f21d7c9573c20547dbbac0f18, server=jenkins-hbase4.apache.org,44723,1676203381600 in 201 msec 2023-02-12 12:03:12,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bdbe768f21d7c9573c20547dbbac0f18, UNASSIGN in 239 msec 2023-02-12 12:03:12,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 12:03:12,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525. 2023-02-12 12:03:12,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 75df4fb9fe6b06c7b9a0a55f7f39d525: Waiting for close lock at 1676203392459Running coprocessor pre-close hooks at 1676203392459Disabling compacts and flushes for region at 1676203392459Disabling writes for close at 1676203392459Writing region close event to WAL at 1676203392472 (+13 ms)Running coprocessor post-close hooks at 1676203392490 (+18 ms)Closed at 1676203392490 2023-02-12 12:03:12,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:12,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:12,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 78294cc27746b50a7ce4dd4247511391, disabling compactions & flushes 2023-02-12 12:03:12,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:12,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:12,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. after waiting 0 ms 2023-02-12 12:03:12,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:12,495 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=75df4fb9fe6b06c7b9a0a55f7f39d525, regionState=CLOSED 2023-02-12 12:03:12,495 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203392495"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392495"}]},"ts":"1676203392495"} 2023-02-12 12:03:12,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-12 12:03:12,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 75df4fb9fe6b06c7b9a0a55f7f39d525, server=jenkins-hbase4.apache.org,38721,1676203381550 in 217 msec 2023-02-12 12:03:12,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=75df4fb9fe6b06c7b9a0a55f7f39d525, UNASSIGN in 256 msec 2023-02-12 12:03:12,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:12,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0. 2023-02-12 12:03:12,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c5446be50ca61a97be28627a3b4b52c0: Waiting for close lock at 1676203392477Running coprocessor pre-close hooks at 1676203392477Disabling compacts and flushes for region at 1676203392477Disabling writes for close at 1676203392477Writing region close event to WAL at 1676203392493 (+16 ms)Running coprocessor post-close hooks at 1676203392507 (+14 ms)Closed at 1676203392508 (+1 ms) 2023-02-12 12:03:12,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:12,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:12,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 89b0bf71a2f758b674372969fa5b1cd4, disabling compactions & flushes 2023-02-12 12:03:12,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:12,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:12,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. after waiting 0 ms 2023-02-12 12:03:12,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:12,510 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c5446be50ca61a97be28627a3b4b52c0, regionState=CLOSED 2023-02-12 12:03:12,510 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392510"}]},"ts":"1676203392510"} 2023-02-12 12:03:12,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:12,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391. 2023-02-12 12:03:12,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 78294cc27746b50a7ce4dd4247511391: Waiting for close lock at 1676203392494Running coprocessor pre-close hooks at 1676203392494Disabling compacts and flushes for region at 1676203392494Disabling writes for close at 1676203392494Writing region close event to WAL at 1676203392509 (+15 ms)Running coprocessor post-close hooks at 1676203392514 (+5 ms)Closed at 1676203392515 (+1 ms) 2023-02-12 12:03:12,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=38 2023-02-12 12:03:12,518 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=78294cc27746b50a7ce4dd4247511391, regionState=CLOSED 2023-02-12 12:03:12,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=38, state=SUCCESS; CloseRegionProcedure c5446be50ca61a97be28627a3b4b52c0, server=jenkins-hbase4.apache.org,44723,1676203381600 in 260 msec 2023-02-12 12:03:12,518 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392518"}]},"ts":"1676203392518"} 2023-02-12 12:03:12,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c5446be50ca61a97be28627a3b4b52c0, UNASSIGN in 275 msec 2023-02-12 12:03:12,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=37 2023-02-12 12:03:12,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=37, state=SUCCESS; CloseRegionProcedure 78294cc27746b50a7ce4dd4247511391, server=jenkins-hbase4.apache.org,38721,1676203381550 in 266 msec 2023-02-12 12:03:12,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=78294cc27746b50a7ce4dd4247511391, UNASSIGN in 279 msec 2023-02-12 12:03:12,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:12,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing de503667a307f5dc3ac8248ab10b0543, disabling compactions & flushes 2023-02-12 12:03:12,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 12:03:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. after waiting 0 ms 2023-02-12 12:03:12,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:12,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4. 2023-02-12 12:03:12,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 89b0bf71a2f758b674372969fa5b1cd4: Waiting for close lock at 1676203392510Running coprocessor pre-close hooks at 1676203392510Disabling compacts and flushes for region at 1676203392510Disabling writes for close at 1676203392510Writing region close event to WAL at 1676203392511 (+1 ms)Running coprocessor post-close hooks at 1676203392525 (+14 ms)Closed at 1676203392528 (+3 ms) 2023-02-12 12:03:12,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:12,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:12,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9f9428638f28b9f7dfb29cdeb2f5c32c, disabling compactions & flushes 2023-02-12 12:03:12,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:12,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:12,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. after waiting 0 ms 2023-02-12 12:03:12,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:12,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=89b0bf71a2f758b674372969fa5b1cd4, regionState=CLOSED 2023-02-12 12:03:12,531 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203392531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392531"}]},"ts":"1676203392531"} 2023-02-12 12:03:12,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-12 12:03:12,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 89b0bf71a2f758b674372969fa5b1cd4, server=jenkins-hbase4.apache.org,44723,1676203381600 in 273 msec 2023-02-12 12:03:12,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=89b0bf71a2f758b674372969fa5b1cd4, UNASSIGN in 290 msec 2023-02-12 12:03:12,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 12:03:12,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:12,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:12,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543. 2023-02-12 12:03:12,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c. 2023-02-12 12:03:12,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for de503667a307f5dc3ac8248ab10b0543: Waiting for close lock at 1676203392524Running coprocessor pre-close hooks at 1676203392524Disabling compacts and flushes for region at 1676203392524Disabling writes for close at 1676203392524Writing region close event to WAL at 1676203392549 (+25 ms)Running coprocessor post-close hooks at 1676203392554 (+5 ms)Closed at 1676203392554 2023-02-12 12:03:12,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9f9428638f28b9f7dfb29cdeb2f5c32c: Waiting for close lock at 1676203392531Running coprocessor pre-close hooks at 1676203392531Disabling compacts and flushes for region at 1676203392531Disabling writes for close at 1676203392531Writing region close event to WAL at 1676203392549 (+18 ms)Running coprocessor post-close hooks at 1676203392554 (+5 ms)Closed at 1676203392555 (+1 ms) 2023-02-12 12:03:12,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:12,558 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=9f9428638f28b9f7dfb29cdeb2f5c32c, regionState=CLOSED 2023-02-12 12:03:12,559 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392558"}]},"ts":"1676203392558"} 2023-02-12 12:03:12,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:12,559 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=de503667a307f5dc3ac8248ab10b0543, regionState=CLOSED 2023-02-12 12:03:12,560 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203392559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203392559"}]},"ts":"1676203392559"} 2023-02-12 12:03:12,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=41 2023-02-12 12:03:12,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=41, state=SUCCESS; CloseRegionProcedure 9f9428638f28b9f7dfb29cdeb2f5c32c, server=jenkins-hbase4.apache.org,44723,1676203381600 in 287 msec 2023-02-12 12:03:12,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=40 2023-02-12 12:03:12,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=40, state=SUCCESS; CloseRegionProcedure de503667a307f5dc3ac8248ab10b0543, server=jenkins-hbase4.apache.org,38721,1676203381550 in 289 msec 2023-02-12 12:03:12,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9f9428638f28b9f7dfb29cdeb2f5c32c, UNASSIGN in 321 msec 2023-02-12 12:03:12,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-12 12:03:12,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=de503667a307f5dc3ac8248ab10b0543, UNASSIGN in 321 msec 2023-02-12 12:03:12,567 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203392567"}]},"ts":"1676203392567"} 2023-02-12 12:03:12,569 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 12:03:12,571 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 12:03:12,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 346 msec 2023-02-12 12:03:12,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 12:03:12,846 INFO [Listener at localhost/35477] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-12 12:03:12,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-12 12:03:12,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:12,860 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:12,862 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:12,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 12:03:12,876 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:12,876 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:12,876 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:12,876 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:12,876 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:12,876 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:12,876 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:12,876 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:12,882 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/recovered.edits] 2023-02-12 12:03:12,883 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/recovered.edits] 2023-02-12 12:03:12,883 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/recovered.edits] 2023-02-12 12:03:12,883 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/recovered.edits] 2023-02-12 12:03:12,883 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/recovered.edits] 2023-02-12 12:03:12,882 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/recovered.edits] 2023-02-12 12:03:12,882 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/recovered.edits] 2023-02-12 12:03:12,886 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/recovered.edits] 2023-02-12 12:03:12,902 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/342c7e47f75b4d8192f6e8fcd57b3fdc to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/342c7e47f75b4d8192f6e8fcd57b3fdc 2023-02-12 12:03:12,902 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/5c26a7407cad45c39e68f0363cc2341a to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/5c26a7407cad45c39e68f0363cc2341a 2023-02-12 12:03:12,902 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/48b7f152442740babd74aa4a678c363e to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/48b7f152442740babd74aa4a678c363e 2023-02-12 12:03:12,903 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/8a5b2084fe244a02a97c9ed317a3e0b1 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/8a5b2084fe244a02a97c9ed317a3e0b1 2023-02-12 12:03:12,903 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/c3fb28b769ca4720835d633b14a8b180 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/c3fb28b769ca4720835d633b14a8b180 2023-02-12 12:03:12,903 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/2492335ce87a4af6a801cf5acc1390a1 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/2492335ce87a4af6a801cf5acc1390a1 2023-02-12 12:03:12,905 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/592ac1d622024745b129550da1b7c5d9 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/592ac1d622024745b129550da1b7c5d9 2023-02-12 12:03:12,908 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/f00be38737ef470abacb47d4a3c37df9 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f1/f00be38737ef470abacb47d4a3c37df9 2023-02-12 12:03:12,930 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/95c3b4a4097f4ddf804ab74b3e38a788 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f1/95c3b4a4097f4ddf804ab74b3e38a788 2023-02-12 12:03:12,931 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/70805cd4ea8c4ee79592e7519e555a91 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f1/70805cd4ea8c4ee79592e7519e555a91 2023-02-12 12:03:12,931 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/dbc604bf2f1c41b8882c352d5e16b2ea to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f1/dbc604bf2f1c41b8882c352d5e16b2ea 2023-02-12 12:03:12,931 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/recovered.edits/6.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525/recovered.edits/6.seqid 2023-02-12 12:03:12,931 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/cd46b7e5db3146fca6d791c19150b7b0 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f1/cd46b7e5db3146fca6d791c19150b7b0 2023-02-12 12:03:12,932 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/71d0454f0aa244b88251e93215cab86e to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f1/71d0454f0aa244b88251e93215cab86e 2023-02-12 12:03:12,932 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/5b67f400fb04412aa687aaf88ef80d5d to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f1/5b67f400fb04412aa687aaf88ef80d5d 2023-02-12 12:03:12,933 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/75df4fb9fe6b06c7b9a0a55f7f39d525 2023-02-12 12:03:12,933 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:12,939 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/4d679f98f4974652aaacafe2984184bc to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/4d679f98f4974652aaacafe2984184bc 2023-02-12 12:03:12,940 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/20d4279ecf80453380855f1c671aa3dc to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/20d4279ecf80453380855f1c671aa3dc 2023-02-12 12:03:12,940 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/recovered.edits] 2023-02-12 12:03:12,941 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/4444fa0bd0674053b7b146c452258152 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/4444fa0bd0674053b7b146c452258152 2023-02-12 12:03:12,942 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/097a66d9d8264f12990db38cb221a5f2 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/097a66d9d8264f12990db38cb221a5f2 2023-02-12 12:03:12,942 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/73ed3c594d4d4f678a217cb71b9e40a9 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/73ed3c594d4d4f678a217cb71b9e40a9 2023-02-12 12:03:12,943 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/6830c4d550d340a5897ef211983b1004 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/6830c4d550d340a5897ef211983b1004 2023-02-12 12:03:12,943 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/3701d3d94ebb4e4d954fbd1068bc75dc to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/3701d3d94ebb4e4d954fbd1068bc75dc 2023-02-12 12:03:12,944 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/9f6acd874a4f42809768eaecdf2d94e1 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/f2/9f6acd874a4f42809768eaecdf2d94e1 2023-02-12 12:03:12,945 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/68377fb0efa24dfbadc8a96d51a387ed to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/f2/68377fb0efa24dfbadc8a96d51a387ed 2023-02-12 12:03:12,946 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/e168f340f19e44a29c90db796f8560dd to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/f2/e168f340f19e44a29c90db796f8560dd 2023-02-12 12:03:12,946 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/992ab275419c4a00834a66a01f2a5643 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/f2/992ab275419c4a00834a66a01f2a5643 2023-02-12 12:03:12,947 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/e92c83cb764241269c70bec13c7c9138 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/f2/e92c83cb764241269c70bec13c7c9138 2023-02-12 12:03:12,947 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/e0ef4e8fae4346d89f7415b83762994f to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/f2/e0ef4e8fae4346d89f7415b83762994f 2023-02-12 12:03:12,948 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/7fed9fb8e6674633821b747aaa43c713 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/f2/7fed9fb8e6674633821b747aaa43c713 2023-02-12 12:03:12,956 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/8a7749c3566a4e79a2c60366676abe19 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/8a7749c3566a4e79a2c60366676abe19 2023-02-12 12:03:12,956 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/recovered.edits/12.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543/recovered.edits/12.seqid 2023-02-12 12:03:12,958 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/recovered.edits/12.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391/recovered.edits/12.seqid 2023-02-12 12:03:12,958 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/de503667a307f5dc3ac8248ab10b0543 2023-02-12 12:03:12,958 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:12,959 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/recovered.edits/12.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b/recovered.edits/12.seqid 2023-02-12 12:03:12,960 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/recovered.edits/12.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0/recovered.edits/12.seqid 2023-02-12 12:03:12,961 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/recovered.edits/12.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18/recovered.edits/12.seqid 2023-02-12 12:03:12,961 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/78294cc27746b50a7ce4dd4247511391 2023-02-12 12:03:12,961 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/72033e60a7bcdebea0d28f7c2147874b 2023-02-12 12:03:12,962 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/recovered.edits/12.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358/recovered.edits/12.seqid 2023-02-12 12:03:12,962 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/c5446be50ca61a97be28627a3b4b52c0 2023-02-12 12:03:12,962 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/9426498cf43447e38f7a57d8ce99ff46 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f1/9426498cf43447e38f7a57d8ce99ff46 2023-02-12 12:03:12,963 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/bdbe768f21d7c9573c20547dbbac0f18 2023-02-12 12:03:12,963 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/92df73bf06fd08e56275a83e22a49358 2023-02-12 12:03:12,964 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/f1, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/f2, FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/recovered.edits] 2023-02-12 12:03:12,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 12:03:12,965 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/recovered.edits/12.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c/recovered.edits/12.seqid 2023-02-12 12:03:12,966 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/9f9428638f28b9f7dfb29cdeb2f5c32c 2023-02-12 12:03:12,969 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/a7a19fba8e784a27838952c5f8213598 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/a7a19fba8e784a27838952c5f8213598 2023-02-12 12:03:12,971 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/b9bdaabd7cfa45e88892f622fed6bc02 to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/f2/b9bdaabd7cfa45e88892f622fed6bc02 2023-02-12 12:03:12,972 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/recovered.edits/6.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4/recovered.edits/6.seqid 2023-02-12 12:03:12,974 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/89b0bf71a2f758b674372969fa5b1cd4 2023-02-12 12:03:12,975 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/recovered.edits/12.seqid to hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/archive/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075/recovered.edits/12.seqid 2023-02-12 12:03:12,975 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/.tmp/data/default/testWithMapReduce/374fb48868fc34b353e6550fdfb28075 2023-02-12 12:03:12,975 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 12:03:12,978 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:13,008 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-12 12:03:13,014 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 12:03:13,016 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:13,016 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 12:03:13,016 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,016 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,016 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,017 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203393016"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,022 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 12:03:13,022 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 75df4fb9fe6b06c7b9a0a55f7f39d525, NAME => 'testWithMapReduce,,1676203384494.75df4fb9fe6b06c7b9a0a55f7f39d525.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => bdbe768f21d7c9573c20547dbbac0f18, NAME => 'testWithMapReduce,aaa,1676203384494.bdbe768f21d7c9573c20547dbbac0f18.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 72033e60a7bcdebea0d28f7c2147874b, NAME => 'testWithMapReduce,d\x84\x84,1676203384494.72033e60a7bcdebea0d28f7c2147874b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 78294cc27746b50a7ce4dd4247511391, NAME => 'testWithMapReduce,g\xA7\xA7,1676203384494.78294cc27746b50a7ce4dd4247511391.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => c5446be50ca61a97be28627a3b4b52c0, NAME => 'testWithMapReduce,j\xCA\xCA,1676203384494.c5446be50ca61a97be28627a3b4b52c0.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 92df73bf06fd08e56275a83e22a49358, NAME => 'testWithMapReduce,m\xED\xED,1676203384494.92df73bf06fd08e56275a83e22a49358.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => de503667a307f5dc3ac8248ab10b0543, NAME => 'testWithMapReduce,q\x11\x10,1676203384494.de503667a307f5dc3ac8248ab10b0543.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 9f9428638f28b9f7dfb29cdeb2f5c32c, NAME => 'testWithMapReduce,t43,1676203384494.9f9428638f28b9f7dfb29cdeb2f5c32c.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 374fb48868fc34b353e6550fdfb28075, NAME => 'testWithMapReduce,wWV,1676203384494.374fb48868fc34b353e6550fdfb28075.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 89b0bf71a2f758b674372969fa5b1cd4, NAME => 'testWithMapReduce,zz{,1676203384494.89b0bf71a2f758b674372969fa5b1cd4.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 12:03:13,022 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 12:03:13,022 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676203393022"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:13,024 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 12:03:13,027 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:13,028 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 175 msec 2023-02-12 12:03:13,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42491] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 12:03:13,168 INFO [Listener at localhost/35477] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-12 12:03:13,168 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 12:03:13,168 INFO [Listener at localhost/35477] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 12:03:13,169 DEBUG [Listener at localhost/35477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ef65de3 to 127.0.0.1:59386 2023-02-12 12:03:13,169 DEBUG [Listener at localhost/35477] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:13,169 DEBUG [Listener at localhost/35477] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 12:03:13,169 DEBUG [Listener at localhost/35477] util.JVMClusterUtil(257): Found active master hash=1079384721, stopped=false 2023-02-12 12:03:13,169 INFO [Listener at localhost/35477] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:13,173 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:13,173 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:13,174 INFO [Listener at localhost/35477] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 12:03:13,173 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:13,175 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:13,175 DEBUG [Listener at localhost/35477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1770603b to 127.0.0.1:59386 2023-02-12 12:03:13,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:13,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:13,175 DEBUG [Listener at localhost/35477] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:13,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:13,176 INFO [Listener at localhost/35477] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38721,1676203381550' ***** 2023-02-12 12:03:13,176 INFO [Listener at localhost/35477] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:13,176 INFO [Listener at localhost/35477] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44723,1676203381600' ***** 2023-02-12 12:03:13,176 INFO [Listener at localhost/35477] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:13,176 INFO [RS:0;jenkins-hbase4:38721] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:13,176 INFO [RS:1;jenkins-hbase4:44723] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:13,177 INFO [RS:0;jenkins-hbase4:38721] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:13,177 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:13,177 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:13,177 INFO [RS:0;jenkins-hbase4:38721] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:13,178 INFO [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:13,178 DEBUG [RS:0;jenkins-hbase4:38721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14e56754 to 127.0.0.1:59386 2023-02-12 12:03:13,178 DEBUG [RS:0;jenkins-hbase4:38721] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:13,178 INFO [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38721,1676203381550; all regions closed. 2023-02-12 12:03:13,177 INFO [RS:1;jenkins-hbase4:44723] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:13,178 INFO [RS:1;jenkins-hbase4:44723] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:13,178 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(3304): Received CLOSE for 280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:13,179 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:13,179 DEBUG [RS:1;jenkins-hbase4:44723] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x763f4acf to 127.0.0.1:59386 2023-02-12 12:03:13,179 DEBUG [RS:1;jenkins-hbase4:44723] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:13,179 INFO [RS:1;jenkins-hbase4:44723] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:13,179 INFO [RS:1;jenkins-hbase4:44723] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:13,179 INFO [RS:1;jenkins-hbase4:44723] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:13,179 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 12:03:13,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 280270a4e0c33d56bfba43ed747050c9, disabling compactions & flushes 2023-02-12 12:03:13,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:13,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:13,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. after waiting 0 ms 2023-02-12 12:03:13,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:13,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 280270a4e0c33d56bfba43ed747050c9 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 12:03:13,200 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 12:03:13,200 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1479): Online Regions={280270a4e0c33d56bfba43ed747050c9=hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9., 1588230740=hbase:meta,,1.1588230740} 2023-02-12 12:03:13,201 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1505): Waiting on 1588230740, 280270a4e0c33d56bfba43ed747050c9 2023-02-12 12:03:13,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:13,204 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:13,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:13,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:13,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:13,205 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-12 12:03:13,208 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:13,208 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:13,211 DEBUG [RS:0;jenkins-hbase4:38721] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/oldWALs 2023-02-12 12:03:13,211 INFO [RS:0;jenkins-hbase4:38721] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38721%2C1676203381550:(num 1676203383996) 2023-02-12 12:03:13,212 DEBUG [RS:0;jenkins-hbase4:38721] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:13,212 INFO [RS:0;jenkins-hbase4:38721] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:13,248 INFO [RS:0;jenkins-hbase4:38721] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:13,248 INFO [RS:0;jenkins-hbase4:38721] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:13,248 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:13,248 INFO [RS:0;jenkins-hbase4:38721] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:13,249 INFO [RS:0;jenkins-hbase4:38721] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:13,266 INFO [RS:0;jenkins-hbase4:38721] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38721 2023-02-12 12:03:13,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9/.tmp/info/215dab57e3e846449a85129ee3a95281 2023-02-12 12:03:13,288 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:13,288 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:13,288 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:13,288 ERROR [Listener at localhost/35477-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2175a05a rejected from java.util.concurrent.ThreadPoolExecutor@254a20ac[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:13,288 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38721,1676203381550 2023-02-12 12:03:13,289 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:13,289 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38721,1676203381550] 2023-02-12 12:03:13,289 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38721,1676203381550; numProcessing=1 2023-02-12 12:03:13,291 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38721,1676203381550 already deleted, retry=false 2023-02-12 12:03:13,291 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38721,1676203381550 expired; onlineServers=1 2023-02-12 12:03:13,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9/.tmp/info/215dab57e3e846449a85129ee3a95281 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9/info/215dab57e3e846449a85129ee3a95281 2023-02-12 12:03:13,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9/info/215dab57e3e846449a85129ee3a95281, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 12:03:13,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 280270a4e0c33d56bfba43ed747050c9 in 136ms, sequenceid=6, compaction requested=false 2023-02-12 12:03:13,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/namespace/280270a4e0c33d56bfba43ed747050c9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 12:03:13,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:13,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 280270a4e0c33d56bfba43ed747050c9: Waiting for close lock at 1676203393179Running coprocessor pre-close hooks at 1676203393179Disabling compacts and flushes for region at 1676203393179Disabling writes for close at 1676203393193 (+14 ms)Obtaining lock to block concurrent updates at 1676203393193Preparing flush snapshotting stores in 280270a4e0c33d56bfba43ed747050c9 at 1676203393193Finished memstore snapshotting hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676203393193Flushing stores of hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. at 1676203393206 (+13 ms)Flushing 280270a4e0c33d56bfba43ed747050c9/info: creating writer at 1676203393206Flushing 280270a4e0c33d56bfba43ed747050c9/info: appending metadata at 1676203393221 (+15 ms)Flushing 280270a4e0c33d56bfba43ed747050c9/info: closing flushed file at 1676203393221Flushing 280270a4e0c33d56bfba43ed747050c9/info: reopening flushed file at 1676203393295 (+74 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 280270a4e0c33d56bfba43ed747050c9 in 136ms, sequenceid=6, compaction requested=false at 1676203393329 (+34 ms)Writing region close event to WAL at 1676203393346 (+17 ms)Running coprocessor post-close hooks at 1676203393352 (+6 ms)Closed at 1676203393352 2023-02-12 12:03:13,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676203383597.280270a4e0c33d56bfba43ed747050c9. 2023-02-12 12:03:13,402 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:13,602 DEBUG [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:13,677 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:13,677 INFO [RS:0;jenkins-hbase4:38721] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38721,1676203381550; zookeeper connection closed. 2023-02-12 12:03:13,677 ERROR [Listener at localhost/35477-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d99e11f rejected from java.util.concurrent.ThreadPoolExecutor@254a20ac[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:13,678 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:38721-0x1004869b48c0001, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:13,678 ERROR [Listener at localhost/35477-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2559f846 rejected from java.util.concurrent.ThreadPoolExecutor@254a20ac[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:13,678 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@46851153] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@46851153 2023-02-12 12:03:13,681 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/.tmp/info/e9af56a5ac44499299f6f6edd1327ecd 2023-02-12 12:03:13,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9af56a5ac44499299f6f6edd1327ecd 2023-02-12 12:03:13,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/.tmp/rep_barrier/5374e042408843af929f93fdfac36c87 2023-02-12 12:03:13,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5374e042408843af929f93fdfac36c87 2023-02-12 12:03:13,745 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/.tmp/table/c738581b924a4c1d8b2fcd438dfa8e1c 2023-02-12 12:03:13,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c738581b924a4c1d8b2fcd438dfa8e1c 2023-02-12 12:03:13,752 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/.tmp/info/e9af56a5ac44499299f6f6edd1327ecd as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/info/e9af56a5ac44499299f6f6edd1327ecd 2023-02-12 12:03:13,760 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9af56a5ac44499299f6f6edd1327ecd 2023-02-12 12:03:13,760 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/info/e9af56a5ac44499299f6f6edd1327ecd, entries=30, sequenceid=57, filesize=7.9 K 2023-02-12 12:03:13,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/.tmp/rep_barrier/5374e042408843af929f93fdfac36c87 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/rep_barrier/5374e042408843af929f93fdfac36c87 2023-02-12 12:03:13,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5374e042408843af929f93fdfac36c87 2023-02-12 12:03:13,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/rep_barrier/5374e042408843af929f93fdfac36c87, entries=10, sequenceid=57, filesize=5.9 K 2023-02-12 12:03:13,768 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/.tmp/table/c738581b924a4c1d8b2fcd438dfa8e1c as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/table/c738581b924a4c1d8b2fcd438dfa8e1c 2023-02-12 12:03:13,779 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c738581b924a4c1d8b2fcd438dfa8e1c 2023-02-12 12:03:13,779 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/table/c738581b924a4c1d8b2fcd438dfa8e1c, entries=13, sequenceid=57, filesize=5.9 K 2023-02-12 12:03:13,780 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 576ms, sequenceid=57, compaction requested=false 2023-02-12 12:03:13,792 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 12:03:13,792 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:13,793 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:13,793 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203393203Running coprocessor pre-close hooks at 1676203393203Disabling compacts and flushes for region at 1676203393203Disabling writes for close at 1676203393204 (+1 ms)Obtaining lock to block concurrent updates at 1676203393205 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676203393205Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676203393205Flushing stores of hbase:meta,,1.1588230740 at 1676203393206 (+1 ms)Flushing 1588230740/info: creating writer at 1676203393206Flushing 1588230740/info: appending metadata at 1676203393239 (+33 ms)Flushing 1588230740/info: closing flushed file at 1676203393239Flushing 1588230740/rep_barrier: creating writer at 1676203393690 (+451 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676203393696 (+6 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676203393697 (+1 ms)Flushing 1588230740/table: creating writer at 1676203393731 (+34 ms)Flushing 1588230740/table: appending metadata at 1676203393734 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676203393734Flushing 1588230740/info: reopening flushed file at 1676203393753 (+19 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676203393762 (+9 ms)Flushing 1588230740/table: reopening flushed file at 1676203393769 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 576ms, sequenceid=57, compaction requested=false at 1676203393780 (+11 ms)Writing region close event to WAL at 1676203393788 (+8 ms)Running coprocessor post-close hooks at 1676203393792 (+4 ms)Closed at 1676203393793 (+1 ms) 2023-02-12 12:03:13,794 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:13,802 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44723,1676203381600; all regions closed. 2023-02-12 12:03:13,807 DEBUG [RS:1;jenkins-hbase4:44723] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/oldWALs 2023-02-12 12:03:13,807 INFO [RS:1;jenkins-hbase4:44723] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44723%2C1676203381600.meta:.meta(num 1676203383323) 2023-02-12 12:03:13,812 DEBUG [RS:1;jenkins-hbase4:44723] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/oldWALs 2023-02-12 12:03:13,812 INFO [RS:1;jenkins-hbase4:44723] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44723%2C1676203381600:(num 1676203383996) 2023-02-12 12:03:13,812 DEBUG [RS:1;jenkins-hbase4:44723] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:13,812 INFO [RS:1;jenkins-hbase4:44723] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:13,813 INFO [RS:1;jenkins-hbase4:44723] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:13,813 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:13,814 INFO [RS:1;jenkins-hbase4:44723] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44723 2023-02-12 12:03:13,818 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44723,1676203381600 2023-02-12 12:03:13,818 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:13,818 ERROR [Listener at localhost/35477-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43dc4ac2 rejected from java.util.concurrent.ThreadPoolExecutor@47e3c661[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:13,819 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44723,1676203381600] 2023-02-12 12:03:13,819 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44723,1676203381600; numProcessing=2 2023-02-12 12:03:13,821 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44723,1676203381600 already deleted, retry=false 2023-02-12 12:03:13,821 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44723,1676203381600 expired; onlineServers=0 2023-02-12 12:03:13,821 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42491,1676203380318' ***** 2023-02-12 12:03:13,821 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 12:03:13,821 DEBUG [M:0;jenkins-hbase4:42491] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16b10aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:13,821 INFO [M:0;jenkins-hbase4:42491] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42491,1676203380318 2023-02-12 12:03:13,821 INFO [M:0;jenkins-hbase4:42491] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42491,1676203380318; all regions closed. 2023-02-12 12:03:13,821 DEBUG [M:0;jenkins-hbase4:42491] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:13,822 DEBUG [M:0;jenkins-hbase4:42491] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 12:03:13,822 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 12:03:13,822 DEBUG [M:0;jenkins-hbase4:42491] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 12:03:13,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203382796] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203382796,5,FailOnTimeoutGroup] 2023-02-12 12:03:13,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203382796] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203382796,5,FailOnTimeoutGroup] 2023-02-12 12:03:13,822 INFO [M:0;jenkins-hbase4:42491] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 12:03:13,823 INFO [M:0;jenkins-hbase4:42491] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 12:03:13,823 INFO [M:0;jenkins-hbase4:42491] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 12:03:13,823 DEBUG [M:0;jenkins-hbase4:42491] master.HMaster(1502): Stopping service threads 2023-02-12 12:03:13,823 INFO [M:0;jenkins-hbase4:42491] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 12:03:13,828 ERROR [M:0;jenkins-hbase4:42491] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-12 12:03:13,830 INFO [M:0;jenkins-hbase4:42491] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 12:03:13,830 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 12:03:13,831 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:13,831 DEBUG [M:0;jenkins-hbase4:42491] zookeeper.ZKUtil(398): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 12:03:13,832 WARN [M:0;jenkins-hbase4:42491] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 12:03:13,832 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:13,832 INFO [M:0;jenkins-hbase4:42491] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 12:03:13,832 INFO [M:0;jenkins-hbase4:42491] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 12:03:13,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:13,833 DEBUG [M:0;jenkins-hbase4:42491] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:13,833 INFO [M:0;jenkins-hbase4:42491] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:13,833 DEBUG [M:0;jenkins-hbase4:42491] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:13,833 DEBUG [M:0;jenkins-hbase4:42491] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:13,833 DEBUG [M:0;jenkins-hbase4:42491] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:13,833 INFO [M:0;jenkins-hbase4:42491] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.23 KB heapSize=192.14 KB 2023-02-12 12:03:13,853 INFO [M:0;jenkins-hbase4:42491] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.23 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3056457247be4f5797cc833f14ddd159 2023-02-12 12:03:13,860 DEBUG [M:0;jenkins-hbase4:42491] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3056457247be4f5797cc833f14ddd159 as hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3056457247be4f5797cc833f14ddd159 2023-02-12 12:03:13,865 INFO [M:0;jenkins-hbase4:42491] regionserver.HStore(1080): Added hdfs://localhost:41375/user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3056457247be4f5797cc833f14ddd159, entries=53, sequenceid=357, filesize=10.4 K 2023-02-12 12:03:13,866 INFO [M:0;jenkins-hbase4:42491] regionserver.HRegion(2947): Finished flush of dataSize ~159.23 KB/163056, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=357, compaction requested=false 2023-02-12 12:03:13,868 INFO [M:0;jenkins-hbase4:42491] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:13,868 DEBUG [M:0;jenkins-hbase4:42491] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203393832Disabling compacts and flushes for region at 1676203393832Disabling writes for close at 1676203393833 (+1 ms)Obtaining lock to block concurrent updates at 1676203393833Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676203393833Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163056, getHeapSize=196736, getOffHeapSize=0, getCellsCount=442 at 1676203393833Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676203393834 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676203393835 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676203393839 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676203393839Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676203393861 (+22 ms)Finished flush of dataSize ~159.23 KB/163056, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=357, compaction requested=false at 1676203393867 (+6 ms)Writing region close event to WAL at 1676203393868 (+1 ms)Closed at 1676203393868 2023-02-12 12:03:13,872 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/c77edfd9-e3ba-d619-43fb-2ce98f6f2ee9/MasterData/WALs/jenkins-hbase4.apache.org,42491,1676203380318/jenkins-hbase4.apache.org%2C42491%2C1676203380318.1676203382059 not finished, retry = 0 2023-02-12 12:03:13,920 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:13,920 INFO [RS:1;jenkins-hbase4:44723] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44723,1676203381600; zookeeper connection closed. 2023-02-12 12:03:13,920 ERROR [Listener at localhost/35477-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12821691 rejected from java.util.concurrent.ThreadPoolExecutor@47e3c661[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:13,920 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x1004869b48c0002, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:13,920 ERROR [Listener at localhost/35477-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a20cc83 rejected from java.util.concurrent.ThreadPoolExecutor@47e3c661[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:13,921 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7d006785] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7d006785 2023-02-12 12:03:13,921 INFO [Listener at localhost/35477] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 12:03:13,973 INFO [M:0;jenkins-hbase4:42491] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 12:03:13,973 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:13,974 INFO [M:0;jenkins-hbase4:42491] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42491 2023-02-12 12:03:13,979 DEBUG [M:0;jenkins-hbase4:42491] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42491,1676203380318 already deleted, retry=false 2023-02-12 12:03:14,081 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:14,081 INFO [M:0;jenkins-hbase4:42491] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42491,1676203380318; zookeeper connection closed. 2023-02-12 12:03:14,082 ERROR [Listener at localhost/35477-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c11f82a rejected from java.util.concurrent.ThreadPoolExecutor@56b5c20d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:14,082 DEBUG [Listener at localhost/35477-EventThread] zookeeper.ZKWatcher(600): master:42491-0x1004869b48c0000, quorum=127.0.0.1:59386, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:14,082 ERROR [Listener at localhost/35477-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68feba4 rejected from java.util.concurrent.ThreadPoolExecutor@56b5c20d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:14,084 WARN [Listener at localhost/35477] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:14,086 INFO [Listener at localhost/35477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:14,167 WARN [BP-1346823952-172.31.14.131-1676203376864 heartbeating to localhost/127.0.0.1:41375] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1346823952-172.31.14.131-1676203376864 (Datanode Uuid b30672b0-0228-4732-8b5e-afb56536b11e) service to localhost/127.0.0.1:41375 2023-02-12 12:03:14,169 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/cluster_a4f83f0c-559c-314d-330e-0afac50f89a6/dfs/data/data3/current/BP-1346823952-172.31.14.131-1676203376864] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:14,170 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/cluster_a4f83f0c-559c-314d-330e-0afac50f89a6/dfs/data/data4/current/BP-1346823952-172.31.14.131-1676203376864] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:14,191 WARN [Listener at localhost/35477] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:14,195 INFO [Listener at localhost/35477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:14,298 WARN [BP-1346823952-172.31.14.131-1676203376864 heartbeating to localhost/127.0.0.1:41375] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:14,298 WARN [BP-1346823952-172.31.14.131-1676203376864 heartbeating to localhost/127.0.0.1:41375] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1346823952-172.31.14.131-1676203376864 (Datanode Uuid 63615642-4b52-485e-a40b-8831830dcef4) service to localhost/127.0.0.1:41375 2023-02-12 12:03:14,299 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/cluster_a4f83f0c-559c-314d-330e-0afac50f89a6/dfs/data/data1/current/BP-1346823952-172.31.14.131-1676203376864] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:14,299 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/cluster_a4f83f0c-559c-314d-330e-0afac50f89a6/dfs/data/data2/current/BP-1346823952-172.31.14.131-1676203376864] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:14,334 INFO [Listener at localhost/35477] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:14,455 INFO [Listener at localhost/35477] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 12:03:14,520 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 12:03:14,534 INFO [Listener at localhost/35477] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42491,1676203380318)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: Listener at localhost/35477 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:41375 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:41375 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:41375 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:41375 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@11e3de86 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41375 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:41375 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:41375 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=547 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=314 (was 221) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=4401 (was 5464) 2023-02-12 12:03:14,544 INFO [Listener at localhost/35477] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=547, MaxFileDescriptor=60000, SystemLoadAverage=314, ProcessCount=165, AvailableMemoryMB=4401 2023-02-12 12:03:14,555 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/hadoop.log.dir so I do NOT create it in target/test-data/7942e900-7232-f18f-ea53-8fca515a7995 2023-02-12 12:03:14,555 WARN [Listener at localhost/35477] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 12:03:14,555 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/hadoop.tmp.dir so I do NOT create it in target/test-data/7942e900-7232-f18f-ea53-8fca515a7995 2023-02-12 12:03:14,555 WARN [Listener at localhost/35477] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4c2378bf-f053-3a62-cad8-b0efc829205c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 12:03:14,555 DEBUG [Listener at localhost/35477] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995 2023-02-12 12:03:14,555 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 12:03:14,555 INFO [Listener at localhost/35477] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/cluster_f10b72fc-55b3-d1b2-5a10-135fc6be91fa, deleteOnExit=true 2023-02-12 12:03:14,555 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 12:03:14,556 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/test.cache.data in system properties and HBase conf 2023-02-12 12:03:14,556 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 12:03:14,556 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/hadoop.log.dir in system properties and HBase conf 2023-02-12 12:03:14,556 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 12:03:14,556 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 12:03:14,556 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 12:03:14,556 DEBUG [Listener at localhost/35477] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/nfs.dump.dir in system properties and HBase conf 2023-02-12 12:03:14,557 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/java.io.tmpdir in system properties and HBase conf 2023-02-12 12:03:14,558 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:14,558 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 12:03:14,558 INFO [Listener at localhost/35477] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 12:03:14,562 WARN [Listener at localhost/35477] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:14,562 WARN [Listener at localhost/35477] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:14,609 WARN [Listener at localhost/35477] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:14,611 INFO [Listener at localhost/35477] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:14,615 INFO [Listener at localhost/35477] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/java.io.tmpdir/Jetty_localhost_37349_hdfs____.mpimv6/webapp 2023-02-12 12:03:14,723 INFO [Listener at localhost/35477] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37349 2023-02-12 12:03:14,727 WARN [Listener at localhost/35477] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:14,727 WARN [Listener at localhost/35477] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:14,767 WARN [Listener at localhost/38661] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:14,788 WARN [Listener at localhost/38661] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:14,792 WARN [Listener at localhost/38661] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:14,793 INFO [Listener at localhost/38661] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:14,797 INFO [Listener at localhost/38661] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/java.io.tmpdir/Jetty_localhost_44967_datanode____.mfse73/webapp 2023-02-12 12:03:14,889 INFO [Listener at localhost/38661] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44967 2023-02-12 12:03:14,896 WARN [Listener at localhost/38833] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:14,915 WARN [Listener at localhost/38833] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:14,919 WARN [Listener at localhost/38833] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:14,921 INFO [Listener at localhost/38833] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:14,925 INFO [Listener at localhost/38833] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/java.io.tmpdir/Jetty_localhost_35585_datanode____.hy3npl/webapp 2023-02-12 12:03:15,004 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1344fb54b4bfe180: Processing first storage report for DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87 from datanode c531b5c7-d43e-4851-bf41-68babf35d0f5 2023-02-12 12:03:15,004 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1344fb54b4bfe180: from storage DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87 node DatanodeRegistration(127.0.0.1:45767, datanodeUuid=c531b5c7-d43e-4851-bf41-68babf35d0f5, infoPort=46137, infoSecurePort=0, ipcPort=38833, storageInfo=lv=-57;cid=testClusterID;nsid=2110300112;c=1676203394564), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:15,004 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1344fb54b4bfe180: Processing first storage report for DS-155bb19b-1f2d-406e-a268-61e236d61ac0 from datanode c531b5c7-d43e-4851-bf41-68babf35d0f5 2023-02-12 12:03:15,005 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1344fb54b4bfe180: from storage DS-155bb19b-1f2d-406e-a268-61e236d61ac0 node DatanodeRegistration(127.0.0.1:45767, datanodeUuid=c531b5c7-d43e-4851-bf41-68babf35d0f5, infoPort=46137, infoSecurePort=0, ipcPort=38833, storageInfo=lv=-57;cid=testClusterID;nsid=2110300112;c=1676203394564), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:15,026 INFO [Listener at localhost/38833] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35585 2023-02-12 12:03:15,034 WARN [Listener at localhost/42921] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:15,145 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b7be6bb45202937: Processing first storage report for DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104 from datanode 93dac768-21ba-47c6-9cb7-58b504daea19 2023-02-12 12:03:15,145 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b7be6bb45202937: from storage DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104 node DatanodeRegistration(127.0.0.1:33785, datanodeUuid=93dac768-21ba-47c6-9cb7-58b504daea19, infoPort=42407, infoSecurePort=0, ipcPort=42921, storageInfo=lv=-57;cid=testClusterID;nsid=2110300112;c=1676203394564), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:15,145 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9b7be6bb45202937: Processing first storage report for DS-2a1bec9d-3a08-4119-afde-851f0e57d20f from datanode 93dac768-21ba-47c6-9cb7-58b504daea19 2023-02-12 12:03:15,145 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9b7be6bb45202937: from storage DS-2a1bec9d-3a08-4119-afde-851f0e57d20f node DatanodeRegistration(127.0.0.1:33785, datanodeUuid=93dac768-21ba-47c6-9cb7-58b504daea19, infoPort=42407, infoSecurePort=0, ipcPort=42921, storageInfo=lv=-57;cid=testClusterID;nsid=2110300112;c=1676203394564), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:15,246 DEBUG [Listener at localhost/42921] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995 2023-02-12 12:03:15,252 INFO [Listener at localhost/42921] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/cluster_f10b72fc-55b3-d1b2-5a10-135fc6be91fa/zookeeper_0, clientPort=62210, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/cluster_f10b72fc-55b3-d1b2-5a10-135fc6be91fa/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/cluster_f10b72fc-55b3-d1b2-5a10-135fc6be91fa/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 12:03:15,254 INFO [Listener at localhost/42921] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62210 2023-02-12 12:03:15,254 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,255 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,271 INFO [Listener at localhost/42921] util.FSUtils(479): Created version file at hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20 with version=8 2023-02-12 12:03:15,271 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,272 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,273 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/hbase-staging 2023-02-12 12:03:15,275 INFO [Listener at localhost/42921] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:15,275 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:15,275 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:15,275 INFO [Listener at localhost/42921] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:15,275 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:15,275 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:15,275 INFO [Listener at localhost/42921] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:15,278 INFO [Listener at localhost/42921] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44927 2023-02-12 12:03:15,278 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,279 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,280 INFO [Listener at localhost/42921] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44927 connecting to ZooKeeper ensemble=127.0.0.1:62210 2023-02-12 12:03:15,290 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:449270x0, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:15,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44927-0x1004869f2750000 connected 2023-02-12 12:03:15,315 DEBUG [Listener at localhost/42921] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:15,316 DEBUG [Listener at localhost/42921] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:15,316 DEBUG [Listener at localhost/42921] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:15,320 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44927 2023-02-12 12:03:15,324 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44927 2023-02-12 12:03:15,324 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44927 2023-02-12 12:03:15,326 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44927 2023-02-12 12:03:15,326 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44927 2023-02-12 12:03:15,327 INFO [Listener at localhost/42921] master.HMaster(439): hbase.rootdir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20, hbase.cluster.distributed=false 2023-02-12 12:03:15,348 INFO [Listener at localhost/42921] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:15,348 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:15,349 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:15,349 INFO [Listener at localhost/42921] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:15,349 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:15,349 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:15,349 INFO [Listener at localhost/42921] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:15,351 INFO [Listener at localhost/42921] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38959 2023-02-12 12:03:15,351 INFO [Listener at localhost/42921] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:15,354 DEBUG [Listener at localhost/42921] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:15,355 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,356 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,358 INFO [Listener at localhost/42921] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38959 connecting to ZooKeeper ensemble=127.0.0.1:62210 2023-02-12 12:03:15,362 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:389590x0, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:15,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38959-0x1004869f2750001 connected 2023-02-12 12:03:15,363 DEBUG [Listener at localhost/42921] zookeeper.ZKUtil(164): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:15,364 DEBUG [Listener at localhost/42921] zookeeper.ZKUtil(164): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:15,365 DEBUG [Listener at localhost/42921] zookeeper.ZKUtil(164): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:15,368 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38959 2023-02-12 12:03:15,368 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38959 2023-02-12 12:03:15,368 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38959 2023-02-12 12:03:15,371 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38959 2023-02-12 12:03:15,371 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38959 2023-02-12 12:03:15,383 INFO [Listener at localhost/42921] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:15,383 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:15,383 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:15,383 INFO [Listener at localhost/42921] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:15,384 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:15,384 INFO [Listener at localhost/42921] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:15,384 INFO [Listener at localhost/42921] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:15,386 INFO [Listener at localhost/42921] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45149 2023-02-12 12:03:15,386 INFO [Listener at localhost/42921] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:15,389 DEBUG [Listener at localhost/42921] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:15,390 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,391 INFO [Listener at localhost/42921] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,391 INFO [Listener at localhost/42921] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45149 connecting to ZooKeeper ensemble=127.0.0.1:62210 2023-02-12 12:03:15,396 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:451490x0, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:15,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45149-0x1004869f2750002 connected 2023-02-12 12:03:15,398 DEBUG [Listener at localhost/42921] zookeeper.ZKUtil(164): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:15,398 DEBUG [Listener at localhost/42921] zookeeper.ZKUtil(164): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:15,399 DEBUG [Listener at localhost/42921] zookeeper.ZKUtil(164): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:15,404 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45149 2023-02-12 12:03:15,404 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45149 2023-02-12 12:03:15,404 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45149 2023-02-12 12:03:15,405 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45149 2023-02-12 12:03:15,405 DEBUG [Listener at localhost/42921] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45149 2023-02-12 12:03:15,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:15,407 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:15,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:15,409 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:15,409 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:15,409 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:15,410 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:15,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:15,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44927,1676203395274 from backup master directory 2023-02-12 12:03:15,413 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:15,413 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:15,413 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:15,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:15,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:15,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/hbase.id with ID: 1a067a4e-a2de-4697-9bab-91f8f6972aaf 2023-02-12 12:03:15,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:15,456 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:15,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6678d305 to 127.0.0.1:62210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:15,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60794e5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:15,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:15,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 12:03:15,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:15,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/data/master/store-tmp 2023-02-12 12:03:15,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:15,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:15,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:15,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:15,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:15,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:15,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:15,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203395493Disabling compacts and flushes for region at 1676203395493Disabling writes for close at 1676203395493Writing region close event to WAL at 1676203395493Closed at 1676203395493 2023-02-12 12:03:15,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/WALs/jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:15,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44927%2C1676203395274, suffix=, logDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/WALs/jenkins-hbase4.apache.org,44927,1676203395274, archiveDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/oldWALs, maxLogs=10 2023-02-12 12:03:15,512 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45767,DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87,DISK] 2023-02-12 12:03:15,513 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33785,DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104,DISK] 2023-02-12 12:03:15,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/WALs/jenkins-hbase4.apache.org,44927,1676203395274/jenkins-hbase4.apache.org%2C44927%2C1676203395274.1676203395497 2023-02-12 12:03:15,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45767,DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87,DISK], DatanodeInfoWithStorage[127.0.0.1:33785,DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104,DISK]] 2023-02-12 12:03:15,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:15,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:15,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:15,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:15,522 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:15,523 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 12:03:15,524 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 12:03:15,524 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:15,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:15,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:15,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:15,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:15,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65574544, jitterRate=-0.022863149642944336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:15,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676203395521Initializing all the Stores at 1676203395521Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203395522 (+1 ms)Cleaning up temporary data from old regions at 1676203395526 (+4 ms)Cleaning up detritus from prior splits at 1676203395526Region opened successfully at 1676203395530 (+4 ms) 2023-02-12 12:03:15,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 12:03:15,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 12:03:15,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 12:03:15,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 12:03:15,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 12:03:15,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 12:03:15,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 12:03:15,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 12:03:15,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 12:03:15,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 12:03:15,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 12:03:15,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 12:03:15,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 12:03:15,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 12:03:15,548 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:15,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 12:03:15,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 12:03:15,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 12:03:15,551 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:15,551 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:15,551 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:15,551 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:15,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,44927,1676203395274, sessionid=0x1004869f2750000, setting cluster-up flag (Was=false) 2023-02-12 12:03:15,556 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:15,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 12:03:15,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:15,565 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:15,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 12:03:15,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:15,572 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.hbase-snapshot/.tmp 2023-02-12 12:03:15,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:15,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:15,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:15,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:15,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:15,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 12:03:15,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:15,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676203425581 2023-02-12 12:03:15,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 12:03:15,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 12:03:15,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 12:03:15,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 12:03:15,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 12:03:15,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 12:03:15,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,582 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:15,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 12:03:15,582 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 12:03:15,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 12:03:15,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 12:03:15,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 12:03:15,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 12:03:15,584 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:15,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203395583,5,FailOnTimeoutGroup] 2023-02-12 12:03:15,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203395584,5,FailOnTimeoutGroup] 2023-02-12 12:03:15,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 12:03:15,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,594 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:15,594 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:15,594 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20 2023-02-12 12:03:15,605 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:15,607 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:15,607 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(952): ClusterId : 1a067a4e-a2de-4697-9bab-91f8f6972aaf 2023-02-12 12:03:15,608 DEBUG [RS:1;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:15,608 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(952): ClusterId : 1a067a4e-a2de-4697-9bab-91f8f6972aaf 2023-02-12 12:03:15,608 DEBUG [RS:0;jenkins-hbase4:38959] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:15,609 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/info 2023-02-12 12:03:15,610 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:15,610 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:15,610 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:15,611 DEBUG [RS:1;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:15,611 DEBUG [RS:1;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:15,611 DEBUG [RS:0;jenkins-hbase4:38959] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:15,611 DEBUG [RS:0;jenkins-hbase4:38959] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:15,614 DEBUG [RS:1;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:15,617 DEBUG [RS:0;jenkins-hbase4:38959] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:15,617 DEBUG [RS:1;jenkins-hbase4:45149] zookeeper.ReadOnlyZKClient(139): Connect 0x5176be45 to 127.0.0.1:62210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:15,618 DEBUG [RS:0;jenkins-hbase4:38959] zookeeper.ReadOnlyZKClient(139): Connect 0x33f40dba to 127.0.0.1:62210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:15,619 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:15,619 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:15,620 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:15,620 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:15,622 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/table 2023-02-12 12:03:15,622 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:15,623 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:15,628 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740 2023-02-12 12:03:15,629 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740 2023-02-12 12:03:15,632 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:15,632 DEBUG [RS:0;jenkins-hbase4:38959] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d33f5b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:15,632 DEBUG [RS:0;jenkins-hbase4:38959] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@390c66ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:15,633 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:15,636 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:15,637 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64128045, jitterRate=-0.04441766440868378}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:15,637 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676203395605Initializing all the Stores at 1676203395607 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203395607Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203395607Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203395607Cleaning up temporary data from old regions at 1676203395630 (+23 ms)Cleaning up detritus from prior splits at 1676203395631 (+1 ms)Region opened successfully at 1676203395637 (+6 ms) 2023-02-12 12:03:15,637 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:15,637 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:15,637 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:15,637 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:15,637 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:15,640 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:15,640 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203395637Disabling compacts and flushes for region at 1676203395637Disabling writes for close at 1676203395637Writing region close event to WAL at 1676203395640 (+3 ms)Closed at 1676203395640 2023-02-12 12:03:15,640 DEBUG [RS:1;jenkins-hbase4:45149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fb15a1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:15,640 DEBUG [RS:1;jenkins-hbase4:45149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b8ed535, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:15,641 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:15,641 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38959 2023-02-12 12:03:15,641 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 12:03:15,641 INFO [RS:0;jenkins-hbase4:38959] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:15,641 INFO [RS:0;jenkins-hbase4:38959] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:15,641 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:15,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 12:03:15,642 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44927,1676203395274 with isa=jenkins-hbase4.apache.org/172.31.14.131:38959, startcode=1676203395348 2023-02-12 12:03:15,642 DEBUG [RS:0;jenkins-hbase4:38959] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:15,644 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 12:03:15,647 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 12:03:15,648 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37091, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:15,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:15,649 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20 2023-02-12 12:03:15,649 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38661 2023-02-12 12:03:15,650 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:15,653 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:15,654 DEBUG [RS:0;jenkins-hbase4:38959] zookeeper.ZKUtil(162): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:15,654 WARN [RS:0;jenkins-hbase4:38959] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:15,654 INFO [RS:0;jenkins-hbase4:38959] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:15,654 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/WALs/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:15,654 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38959,1676203395348] 2023-02-12 12:03:15,656 DEBUG [RS:1;jenkins-hbase4:45149] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45149 2023-02-12 12:03:15,656 INFO [RS:1;jenkins-hbase4:45149] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:15,656 INFO [RS:1;jenkins-hbase4:45149] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:15,656 DEBUG [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:15,657 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44927,1676203395274 with isa=jenkins-hbase4.apache.org/172.31.14.131:45149, startcode=1676203395383 2023-02-12 12:03:15,657 DEBUG [RS:1;jenkins-hbase4:45149] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:15,658 DEBUG [RS:0;jenkins-hbase4:38959] zookeeper.ZKUtil(162): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:15,661 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52635, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:15,661 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:15,662 INFO [RS:0;jenkins-hbase4:38959] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:15,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:15,662 DEBUG [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20 2023-02-12 12:03:15,662 DEBUG [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38661 2023-02-12 12:03:15,663 DEBUG [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:15,667 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:15,667 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:15,667 DEBUG [RS:1;jenkins-hbase4:45149] zookeeper.ZKUtil(162): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:15,667 WARN [RS:1;jenkins-hbase4:45149] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:15,667 INFO [RS:1;jenkins-hbase4:45149] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:15,667 DEBUG [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/WALs/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:15,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:15,668 INFO [RS:0;jenkins-hbase4:38959] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:15,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:15,668 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45149,1676203395383] 2023-02-12 12:03:15,668 INFO [RS:0;jenkins-hbase4:38959] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:15,668 INFO [RS:0;jenkins-hbase4:38959] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,674 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:15,676 INFO [RS:0;jenkins-hbase4:38959] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,676 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,676 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,677 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,677 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,677 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,677 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:15,677 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,677 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,677 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,677 DEBUG [RS:0;jenkins-hbase4:38959] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,677 DEBUG [RS:1;jenkins-hbase4:45149] zookeeper.ZKUtil(162): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:15,678 DEBUG [RS:1;jenkins-hbase4:45149] zookeeper.ZKUtil(162): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:15,678 DEBUG [RS:1;jenkins-hbase4:45149] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:15,679 INFO [RS:1;jenkins-hbase4:45149] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:15,681 INFO [RS:1;jenkins-hbase4:45149] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:15,681 INFO [RS:0;jenkins-hbase4:38959] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,681 INFO [RS:0;jenkins-hbase4:38959] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,682 INFO [RS:0;jenkins-hbase4:38959] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,682 INFO [RS:1;jenkins-hbase4:45149] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:15,682 INFO [RS:1;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,682 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:15,683 INFO [RS:1;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,683 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,683 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,684 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,684 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,684 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,684 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:15,684 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,684 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,684 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,684 DEBUG [RS:1;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:15,688 INFO [RS:1;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,688 INFO [RS:1;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,688 INFO [RS:1;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,694 INFO [RS:0;jenkins-hbase4:38959] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:15,694 INFO [RS:0;jenkins-hbase4:38959] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38959,1676203395348-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,700 INFO [RS:1;jenkins-hbase4:45149] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:15,700 INFO [RS:1;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45149,1676203395383-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:15,706 INFO [RS:0;jenkins-hbase4:38959] regionserver.Replication(203): jenkins-hbase4.apache.org,38959,1676203395348 started 2023-02-12 12:03:15,706 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38959,1676203395348, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38959, sessionid=0x1004869f2750001 2023-02-12 12:03:15,706 DEBUG [RS:0;jenkins-hbase4:38959] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:15,706 DEBUG [RS:0;jenkins-hbase4:38959] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:15,706 DEBUG [RS:0;jenkins-hbase4:38959] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38959,1676203395348' 2023-02-12 12:03:15,706 DEBUG [RS:0;jenkins-hbase4:38959] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:15,706 DEBUG [RS:0;jenkins-hbase4:38959] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:15,707 DEBUG [RS:0;jenkins-hbase4:38959] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:15,707 DEBUG [RS:0;jenkins-hbase4:38959] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:15,707 DEBUG [RS:0;jenkins-hbase4:38959] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:15,707 DEBUG [RS:0;jenkins-hbase4:38959] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38959,1676203395348' 2023-02-12 12:03:15,707 DEBUG [RS:0;jenkins-hbase4:38959] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:15,707 DEBUG [RS:0;jenkins-hbase4:38959] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:15,708 DEBUG [RS:0;jenkins-hbase4:38959] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:15,708 INFO [RS:0;jenkins-hbase4:38959] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:15,708 INFO [RS:0;jenkins-hbase4:38959] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:15,716 INFO [RS:1;jenkins-hbase4:45149] regionserver.Replication(203): jenkins-hbase4.apache.org,45149,1676203395383 started 2023-02-12 12:03:15,716 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45149,1676203395383, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45149, sessionid=0x1004869f2750002 2023-02-12 12:03:15,716 DEBUG [RS:1;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:15,716 DEBUG [RS:1;jenkins-hbase4:45149] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:15,716 DEBUG [RS:1;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45149,1676203395383' 2023-02-12 12:03:15,716 DEBUG [RS:1;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:15,716 DEBUG [RS:1;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:15,717 DEBUG [RS:1;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:15,717 DEBUG [RS:1;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:15,717 DEBUG [RS:1;jenkins-hbase4:45149] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:15,717 DEBUG [RS:1;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45149,1676203395383' 2023-02-12 12:03:15,717 DEBUG [RS:1;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:15,717 DEBUG [RS:1;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:15,718 DEBUG [RS:1;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:15,718 INFO [RS:1;jenkins-hbase4:45149] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:15,718 INFO [RS:1;jenkins-hbase4:45149] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:15,798 DEBUG [jenkins-hbase4:44927] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 12:03:15,798 DEBUG [jenkins-hbase4:44927] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:15,800 DEBUG [jenkins-hbase4:44927] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:15,800 DEBUG [jenkins-hbase4:44927] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:15,800 DEBUG [jenkins-hbase4:44927] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:15,802 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38959,1676203395348, state=OPENING 2023-02-12 12:03:15,803 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 12:03:15,810 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:15,811 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:15,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38959,1676203395348}] 2023-02-12 12:03:15,965 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:15,966 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:15,969 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42142, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:15,974 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 12:03:15,974 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:15,976 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38959%2C1676203395348.meta, suffix=.meta, logDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/WALs/jenkins-hbase4.apache.org,38959,1676203395348, archiveDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/oldWALs, maxLogs=32 2023-02-12 12:03:16,004 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33785,DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104,DISK] 2023-02-12 12:03:16,005 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45767,DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87,DISK] 2023-02-12 12:03:16,008 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/WALs/jenkins-hbase4.apache.org,38959,1676203395348/jenkins-hbase4.apache.org%2C38959%2C1676203395348.meta.1676203395978.meta 2023-02-12 12:03:16,008 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33785,DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104,DISK], DatanodeInfoWithStorage[127.0.0.1:45767,DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87,DISK]] 2023-02-12 12:03:16,009 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:16,009 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 12:03:16,009 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 12:03:16,010 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 12:03:16,010 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 12:03:16,010 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:16,011 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 12:03:16,011 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 12:03:16,012 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:16,013 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/info 2023-02-12 12:03:16,013 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/info 2023-02-12 12:03:16,013 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:16,014 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:16,014 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:16,015 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:16,015 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:16,015 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:16,016 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:16,016 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:16,017 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/table 2023-02-12 12:03:16,017 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/table 2023-02-12 12:03:16,017 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:16,018 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:16,019 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740 2023-02-12 12:03:16,020 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740 2023-02-12 12:03:16,022 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:16,024 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:16,025 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69491616, jitterRate=0.03550577163696289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:16,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676203396011Writing region info on filesystem at 1676203396011Initializing all the Stores at 1676203396012 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203396012Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203396012Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203396012Cleaning up temporary data from old regions at 1676203396021 (+9 ms)Cleaning up detritus from prior splits at 1676203396021Running coprocessor post-open hooks at 1676203396025 (+4 ms)Region opened successfully at 1676203396025 2023-02-12 12:03:16,026 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676203395965 2023-02-12 12:03:16,031 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 12:03:16,031 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 12:03:16,031 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38959,1676203395348, state=OPEN 2023-02-12 12:03:16,088 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 12:03:16,088 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:16,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 12:03:16,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38959,1676203395348 in 277 msec 2023-02-12 12:03:16,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 12:03:16,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 453 msec 2023-02-12 12:03:16,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 525 msec 2023-02-12 12:03:16,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676203395408, completionTime=-1 2023-02-12 12:03:16,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 12:03:16,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 12:03:16,103 DEBUG [hconnection-0xd61b38a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:16,106 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42154, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:16,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 12:03:16,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676203456108 2023-02-12 12:03:16,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676203516108 2023-02-12 12:03:16,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 9 msec 2023-02-12 12:03:16,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44927,1676203395274-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:16,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44927,1676203395274-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:16,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44927,1676203395274-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:16,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44927, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:16,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:16,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 12:03:16,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:16,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 12:03:16,192 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 12:03:16,193 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:16,194 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:16,197 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:16,197 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9 empty. 2023-02-12 12:03:16,198 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:16,198 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 12:03:16,215 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:16,216 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 811f0e91a43bae27553f1c50fcfe0cc9, NAME => 'hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:16,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:16,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 811f0e91a43bae27553f1c50fcfe0cc9, disabling compactions & flushes 2023-02-12 12:03:16,230 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:16,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:16,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. after waiting 0 ms 2023-02-12 12:03:16,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:16,230 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:16,230 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 811f0e91a43bae27553f1c50fcfe0cc9: Waiting for close lock at 1676203396230Disabling compacts and flushes for region at 1676203396230Disabling writes for close at 1676203396230Writing region close event to WAL at 1676203396230Closed at 1676203396230 2023-02-12 12:03:16,252 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:16,254 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203396254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203396254"}]},"ts":"1676203396254"} 2023-02-12 12:03:16,262 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:16,264 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:16,264 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203396264"}]},"ts":"1676203396264"} 2023-02-12 12:03:16,266 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 12:03:16,373 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:16,374 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:16,374 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:16,374 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:16,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=811f0e91a43bae27553f1c50fcfe0cc9, ASSIGN}] 2023-02-12 12:03:16,377 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=811f0e91a43bae27553f1c50fcfe0cc9, ASSIGN 2023-02-12 12:03:16,378 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=811f0e91a43bae27553f1c50fcfe0cc9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1676203395383; forceNewPlan=false, retain=false 2023-02-12 12:03:16,528 INFO [jenkins-hbase4:44927] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:16,529 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=811f0e91a43bae27553f1c50fcfe0cc9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:16,530 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203396529"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203396529"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203396529"}]},"ts":"1676203396529"} 2023-02-12 12:03:16,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 811f0e91a43bae27553f1c50fcfe0cc9, server=jenkins-hbase4.apache.org,45149,1676203395383}] 2023-02-12 12:03:16,686 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:16,688 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:16,692 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43136, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:16,697 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:16,708 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45149%2C1676203395383, suffix=, logDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/WALs/jenkins-hbase4.apache.org,45149,1676203395383, archiveDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/oldWALs, maxLogs=32 2023-02-12 12:03:16,713 INFO [RS:0;jenkins-hbase4:38959] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38959%2C1676203395348, suffix=, logDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/WALs/jenkins-hbase4.apache.org,38959,1676203395348, archiveDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/oldWALs, maxLogs=32 2023-02-12 12:03:16,749 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45767,DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87,DISK] 2023-02-12 12:03:16,752 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33785,DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104,DISK] 2023-02-12 12:03:16,771 INFO [RS:0;jenkins-hbase4:38959] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/WALs/jenkins-hbase4.apache.org,38959,1676203395348/jenkins-hbase4.apache.org%2C38959%2C1676203395348.1676203396714 2023-02-12 12:03:16,774 DEBUG [RS:0;jenkins-hbase4:38959] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45767,DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87,DISK], DatanodeInfoWithStorage[127.0.0.1:33785,DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104,DISK]] 2023-02-12 12:03:16,787 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33785,DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104,DISK] 2023-02-12 12:03:16,788 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45767,DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87,DISK] 2023-02-12 12:03:16,796 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/WALs/jenkins-hbase4.apache.org,45149,1676203395383/jenkins-hbase4.apache.org%2C45149%2C1676203395383.1676203396710 2023-02-12 12:03:16,796 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33785,DS-d05a5cb8-1f7e-48f2-8ad8-86cb713f7104,DISK], DatanodeInfoWithStorage[127.0.0.1:45767,DS-474b0b44-f40c-41ae-abd9-8ddc54ae8e87,DISK]] 2023-02-12 12:03:16,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 811f0e91a43bae27553f1c50fcfe0cc9, NAME => 'hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:16,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:16,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:16,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:16,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:16,808 INFO [StoreOpener-811f0e91a43bae27553f1c50fcfe0cc9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:16,812 DEBUG [StoreOpener-811f0e91a43bae27553f1c50fcfe0cc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9/info 2023-02-12 12:03:16,812 DEBUG [StoreOpener-811f0e91a43bae27553f1c50fcfe0cc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9/info 2023-02-12 12:03:16,813 INFO [StoreOpener-811f0e91a43bae27553f1c50fcfe0cc9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 811f0e91a43bae27553f1c50fcfe0cc9 columnFamilyName info 2023-02-12 12:03:16,814 INFO [StoreOpener-811f0e91a43bae27553f1c50fcfe0cc9-1] regionserver.HStore(310): Store=811f0e91a43bae27553f1c50fcfe0cc9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:16,815 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:16,815 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:16,819 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:16,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:16,829 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 811f0e91a43bae27553f1c50fcfe0cc9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59349916, jitterRate=-0.11561733484268188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:16,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 811f0e91a43bae27553f1c50fcfe0cc9: Running coprocessor pre-open hook at 1676203396797Writing region info on filesystem at 1676203396797Initializing all the Stores at 1676203396799 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203396799Cleaning up temporary data from old regions at 1676203396816 (+17 ms)Cleaning up detritus from prior splits at 1676203396816Running coprocessor post-open hooks at 1676203396829 (+13 ms)Region opened successfully at 1676203396829 2023-02-12 12:03:16,830 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9., pid=6, masterSystemTime=1676203396686 2023-02-12 12:03:16,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:16,838 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:16,843 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=811f0e91a43bae27553f1c50fcfe0cc9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:16,843 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203396843"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203396843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203396843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203396843"}]},"ts":"1676203396843"} 2023-02-12 12:03:16,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 12:03:16,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 811f0e91a43bae27553f1c50fcfe0cc9, server=jenkins-hbase4.apache.org,45149,1676203395383 in 314 msec 2023-02-12 12:03:16,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 12:03:16,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=811f0e91a43bae27553f1c50fcfe0cc9, ASSIGN in 493 msec 2023-02-12 12:03:16,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:16,873 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203396873"}]},"ts":"1676203396873"} 2023-02-12 12:03:16,875 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 12:03:16,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 12:03:16,974 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:16,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 784 msec 2023-02-12 12:03:17,057 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:17,057 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:17,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:17,062 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43142, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:17,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 12:03:17,120 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:17,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 94 msec 2023-02-12 12:03:17,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 12:03:17,226 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:17,298 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 129 msec 2023-02-12 12:03:17,435 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 12:03:17,580 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 12:03:17,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.167sec 2023-02-12 12:03:17,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 12:03:17,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 12:03:17,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 12:03:17,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44927,1676203395274-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 12:03:17,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44927,1676203395274-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 12:03:17,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 12:03:17,608 DEBUG [Listener at localhost/42921] zookeeper.ReadOnlyZKClient(139): Connect 0x1c6a4fc1 to 127.0.0.1:62210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:17,665 DEBUG [Listener at localhost/42921] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30448096, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:17,667 DEBUG [hconnection-0x4387c1f2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:17,672 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:17,675 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:17,675 DEBUG [Listener at localhost/42921] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 12:03:17,678 DEBUG [Listener at localhost/42921] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 12:03:17,680 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 12:03:17,680 INFO [Listener at localhost/42921] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 12:03:17,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 12:03:17,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 12:03:17,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:57858 deadline: 1676203457681, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 12:03:17,682 INFO [Listener at localhost/42921] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 12:03:17,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:17,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 12:03:17,688 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:17,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 12:03:17,689 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:17,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:17,698 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:17,698 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:17,698 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:17,698 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:17,698 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:17,698 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc 2023-02-12 12:03:17,698 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:17,698 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:17,699 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a empty. 2023-02-12 12:03:17,699 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3 empty. 2023-02-12 12:03:17,699 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc empty. 2023-02-12 12:03:17,699 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e empty. 2023-02-12 12:03:17,699 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711 empty. 2023-02-12 12:03:17,700 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4 empty. 2023-02-12 12:03:17,700 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:17,700 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:17,700 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:17,700 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:17,701 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:17,701 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f empty. 2023-02-12 12:03:17,701 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd empty. 2023-02-12 12:03:17,702 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20 empty. 2023-02-12 12:03:17,702 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:17,702 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc 2023-02-12 12:03:17,702 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58 empty. 2023-02-12 12:03:17,702 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:17,702 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:17,702 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:17,702 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:17,702 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:17,702 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 12:03:17,715 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:17,717 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9fdbdad26d3d788587798ebf73be17d4, NAME => 'testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,717 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => dd7eac03420b5d08ba5e8ed75de2df7e, NAME => 'testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,717 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 349509f1216b0a92a12cfc3d7115404a, NAME => 'testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9fdbdad26d3d788587798ebf73be17d4, disabling compactions & flushes 2023-02-12 12:03:17,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:17,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:17,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. after waiting 0 ms 2023-02-12 12:03:17,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:17,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:17,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing dd7eac03420b5d08ba5e8ed75de2df7e, disabling compactions & flushes 2023-02-12 12:03:17,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9fdbdad26d3d788587798ebf73be17d4: Waiting for close lock at 1676203397731Disabling compacts and flushes for region at 1676203397731Disabling writes for close at 1676203397731Writing region close event to WAL at 1676203397731Closed at 1676203397731 2023-02-12 12:03:17,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:17,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:17,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. after waiting 0 ms 2023-02-12 12:03:17,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:17,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,732 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ae9f25198523ff4989772be17b20b711, NAME => 'testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 349509f1216b0a92a12cfc3d7115404a, disabling compactions & flushes 2023-02-12 12:03:17,732 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:17,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for dd7eac03420b5d08ba5e8ed75de2df7e: Waiting for close lock at 1676203397731Disabling compacts and flushes for region at 1676203397731Disabling writes for close at 1676203397732 (+1 ms)Writing region close event to WAL at 1676203397732Closed at 1676203397732 2023-02-12 12:03:17,732 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:17,733 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:17,733 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7c935bb96b6eefe3d9f88a5f3c0c47f3, NAME => 'testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,733 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. after waiting 0 ms 2023-02-12 12:03:17,733 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:17,733 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:17,733 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 349509f1216b0a92a12cfc3d7115404a: Waiting for close lock at 1676203397732Disabling compacts and flushes for region at 1676203397732Disabling writes for close at 1676203397733 (+1 ms)Writing region close event to WAL at 1676203397733Closed at 1676203397733 2023-02-12 12:03:17,733 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => fb0dff0e70a5d13ebabc7d0c10b510bd, NAME => 'testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,759 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,760 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7c935bb96b6eefe3d9f88a5f3c0c47f3, disabling compactions & flushes 2023-02-12 12:03:17,760 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:17,760 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:17,760 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. after waiting 0 ms 2023-02-12 12:03:17,760 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:17,760 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:17,760 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7c935bb96b6eefe3d9f88a5f3c0c47f3: Waiting for close lock at 1676203397760Disabling compacts and flushes for region at 1676203397760Disabling writes for close at 1676203397760Writing region close event to WAL at 1676203397760Closed at 1676203397760 2023-02-12 12:03:17,761 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d06b98edd97b470ebe5c7bd4dc373b7f, NAME => 'testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing fb0dff0e70a5d13ebabc7d0c10b510bd, disabling compactions & flushes 2023-02-12 12:03:17,762 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ae9f25198523ff4989772be17b20b711, disabling compactions & flushes 2023-02-12 12:03:17,762 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. after waiting 0 ms 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. after waiting 0 ms 2023-02-12 12:03:17,762 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:17,762 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for fb0dff0e70a5d13ebabc7d0c10b510bd: Waiting for close lock at 1676203397762Disabling compacts and flushes for region at 1676203397762Disabling writes for close at 1676203397762Writing region close event to WAL at 1676203397762Closed at 1676203397762 2023-02-12 12:03:17,762 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:17,763 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ae9f25198523ff4989772be17b20b711: Waiting for close lock at 1676203397762Disabling compacts and flushes for region at 1676203397762Disabling writes for close at 1676203397762Writing region close event to WAL at 1676203397762Closed at 1676203397762 2023-02-12 12:03:17,763 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 73ac448467573948a815516a288a05fc, NAME => 'testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,763 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b74578a527e8a472b5e0eb8682764b58, NAME => 'testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,771 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,771 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d06b98edd97b470ebe5c7bd4dc373b7f, disabling compactions & flushes 2023-02-12 12:03:17,771 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:17,771 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:17,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. after waiting 0 ms 2023-02-12 12:03:17,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:17,772 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:17,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d06b98edd97b470ebe5c7bd4dc373b7f: Waiting for close lock at 1676203397771Disabling compacts and flushes for region at 1676203397771Disabling writes for close at 1676203397772 (+1 ms)Writing region close event to WAL at 1676203397772Closed at 1676203397772 2023-02-12 12:03:17,772 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2d075e1d85beb58c0572d12964b34a20, NAME => 'testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.tmp 2023-02-12 12:03:17,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b74578a527e8a472b5e0eb8682764b58, disabling compactions & flushes 2023-02-12 12:03:17,773 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:17,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:17,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. after waiting 0 ms 2023-02-12 12:03:17,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:17,773 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:17,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b74578a527e8a472b5e0eb8682764b58: Waiting for close lock at 1676203397773Disabling compacts and flushes for region at 1676203397773Disabling writes for close at 1676203397773Writing region close event to WAL at 1676203397773Closed at 1676203397773 2023-02-12 12:03:17,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,774 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 73ac448467573948a815516a288a05fc, disabling compactions & flushes 2023-02-12 12:03:17,774 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:17,774 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:17,774 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. after waiting 0 ms 2023-02-12 12:03:17,774 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:17,774 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:17,774 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 73ac448467573948a815516a288a05fc: Waiting for close lock at 1676203397774Disabling compacts and flushes for region at 1676203397774Disabling writes for close at 1676203397774Writing region close event to WAL at 1676203397774Closed at 1676203397774 2023-02-12 12:03:17,782 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:17,782 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 2d075e1d85beb58c0572d12964b34a20, disabling compactions & flushes 2023-02-12 12:03:17,782 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:17,782 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:17,782 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. after waiting 0 ms 2023-02-12 12:03:17,782 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:17,782 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:17,783 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 2d075e1d85beb58c0572d12964b34a20: Waiting for close lock at 1676203397782Disabling compacts and flushes for region at 1676203397782Disabling writes for close at 1676203397782Writing region close event to WAL at 1676203397782Closed at 1676203397782 2023-02-12 12:03:17,785 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203397786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203397786"}]},"ts":"1676203397786"} 2023-02-12 12:03:17,791 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 12:03:17,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:17,792 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:17,792 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203397792"}]},"ts":"1676203397792"} 2023-02-12 12:03:17,793 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 12:03:17,904 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:17,913 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:17,913 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:17,913 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:17,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=349509f1216b0a92a12cfc3d7115404a, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dd7eac03420b5d08ba5e8ed75de2df7e, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9fdbdad26d3d788587798ebf73be17d4, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ae9f25198523ff4989772be17b20b711, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7c935bb96b6eefe3d9f88a5f3c0c47f3, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fb0dff0e70a5d13ebabc7d0c10b510bd, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d06b98edd97b470ebe5c7bd4dc373b7f, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=73ac448467573948a815516a288a05fc, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b74578a527e8a472b5e0eb8682764b58, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2d075e1d85beb58c0572d12964b34a20, ASSIGN}] 2023-02-12 12:03:17,916 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9fdbdad26d3d788587798ebf73be17d4, ASSIGN 2023-02-12 12:03:17,916 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7c935bb96b6eefe3d9f88a5f3c0c47f3, ASSIGN 2023-02-12 12:03:17,916 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ae9f25198523ff4989772be17b20b711, ASSIGN 2023-02-12 12:03:17,916 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dd7eac03420b5d08ba5e8ed75de2df7e, ASSIGN 2023-02-12 12:03:17,918 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9fdbdad26d3d788587798ebf73be17d4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38959,1676203395348; forceNewPlan=false, retain=false 2023-02-12 12:03:17,918 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7c935bb96b6eefe3d9f88a5f3c0c47f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1676203395383; forceNewPlan=false, retain=false 2023-02-12 12:03:17,918 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ae9f25198523ff4989772be17b20b711, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1676203395383; forceNewPlan=false, retain=false 2023-02-12 12:03:17,918 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dd7eac03420b5d08ba5e8ed75de2df7e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1676203395383; forceNewPlan=false, retain=false 2023-02-12 12:03:17,918 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2d075e1d85beb58c0572d12964b34a20, ASSIGN 2023-02-12 12:03:17,919 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b74578a527e8a472b5e0eb8682764b58, ASSIGN 2023-02-12 12:03:17,919 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d06b98edd97b470ebe5c7bd4dc373b7f, ASSIGN 2023-02-12 12:03:17,919 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=73ac448467573948a815516a288a05fc, ASSIGN 2023-02-12 12:03:17,919 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2d075e1d85beb58c0572d12964b34a20, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1676203395383; forceNewPlan=false, retain=false 2023-02-12 12:03:17,919 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b74578a527e8a472b5e0eb8682764b58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1676203395383; forceNewPlan=false, retain=false 2023-02-12 12:03:17,919 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fb0dff0e70a5d13ebabc7d0c10b510bd, ASSIGN 2023-02-12 12:03:17,919 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d06b98edd97b470ebe5c7bd4dc373b7f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38959,1676203395348; forceNewPlan=false, retain=false 2023-02-12 12:03:17,920 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=73ac448467573948a815516a288a05fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38959,1676203395348; forceNewPlan=false, retain=false 2023-02-12 12:03:17,920 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fb0dff0e70a5d13ebabc7d0c10b510bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38959,1676203395348; forceNewPlan=false, retain=false 2023-02-12 12:03:17,920 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=349509f1216b0a92a12cfc3d7115404a, ASSIGN 2023-02-12 12:03:17,921 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=349509f1216b0a92a12cfc3d7115404a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38959,1676203395348; forceNewPlan=false, retain=false 2023-02-12 12:03:17,938 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 12:03:17,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:18,068 INFO [jenkins-hbase4:44927] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 12:03:18,072 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b74578a527e8a472b5e0eb8682764b58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,072 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7c935bb96b6eefe3d9f88a5f3c0c47f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,072 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2d075e1d85beb58c0572d12964b34a20, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,072 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398072"}]},"ts":"1676203398072"} 2023-02-12 12:03:18,072 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203398072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398072"}]},"ts":"1676203398072"} 2023-02-12 12:03:18,072 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ae9f25198523ff4989772be17b20b711, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,072 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dd7eac03420b5d08ba5e8ed75de2df7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,072 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398072"}]},"ts":"1676203398072"} 2023-02-12 12:03:18,073 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398072"}]},"ts":"1676203398072"} 2023-02-12 12:03:18,072 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398072"}]},"ts":"1676203398072"} 2023-02-12 12:03:18,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure b74578a527e8a472b5e0eb8682764b58, server=jenkins-hbase4.apache.org,45149,1676203395383}] 2023-02-12 12:03:18,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=20, state=RUNNABLE; OpenRegionProcedure 2d075e1d85beb58c0572d12964b34a20, server=jenkins-hbase4.apache.org,45149,1676203395383}] 2023-02-12 12:03:18,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 7c935bb96b6eefe3d9f88a5f3c0c47f3, server=jenkins-hbase4.apache.org,45149,1676203395383}] 2023-02-12 12:03:18,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure dd7eac03420b5d08ba5e8ed75de2df7e, server=jenkins-hbase4.apache.org,45149,1676203395383}] 2023-02-12 12:03:18,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=14, state=RUNNABLE; OpenRegionProcedure ae9f25198523ff4989772be17b20b711, server=jenkins-hbase4.apache.org,45149,1676203395383}] 2023-02-12 12:03:18,079 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fb0dff0e70a5d13ebabc7d0c10b510bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,079 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398079"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398079"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398079"}]},"ts":"1676203398079"} 2023-02-12 12:03:18,080 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=349509f1216b0a92a12cfc3d7115404a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,080 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203398080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398080"}]},"ts":"1676203398080"} 2023-02-12 12:03:18,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=16, state=RUNNABLE; OpenRegionProcedure fb0dff0e70a5d13ebabc7d0c10b510bd, server=jenkins-hbase4.apache.org,38959,1676203395348}] 2023-02-12 12:03:18,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 349509f1216b0a92a12cfc3d7115404a, server=jenkins-hbase4.apache.org,38959,1676203395348}] 2023-02-12 12:03:18,084 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=73ac448467573948a815516a288a05fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,084 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398084"}]},"ts":"1676203398084"} 2023-02-12 12:03:18,085 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9fdbdad26d3d788587798ebf73be17d4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,085 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398085"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398085"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398085"}]},"ts":"1676203398085"} 2023-02-12 12:03:18,084 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d06b98edd97b470ebe5c7bd4dc373b7f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,085 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203398084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203398084"}]},"ts":"1676203398084"} 2023-02-12 12:03:18,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 73ac448467573948a815516a288a05fc, server=jenkins-hbase4.apache.org,38959,1676203395348}] 2023-02-12 12:03:18,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure 9fdbdad26d3d788587798ebf73be17d4, server=jenkins-hbase4.apache.org,38959,1676203395348}] 2023-02-12 12:03:18,091 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure d06b98edd97b470ebe5c7bd4dc373b7f, server=jenkins-hbase4.apache.org,38959,1676203395348}] 2023-02-12 12:03:18,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:18,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b74578a527e8a472b5e0eb8682764b58, NAME => 'testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 12:03:18,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:18,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:18,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:18,233 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:18,234 DEBUG [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1 2023-02-12 12:03:18,235 DEBUG [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1 2023-02-12 12:03:18,235 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b74578a527e8a472b5e0eb8682764b58 columnFamilyName f1 2023-02-12 12:03:18,236 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(310): Store=b74578a527e8a472b5e0eb8682764b58/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,236 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:18,238 DEBUG [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2 2023-02-12 12:03:18,238 DEBUG [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2 2023-02-12 12:03:18,238 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b74578a527e8a472b5e0eb8682764b58 columnFamilyName f2 2023-02-12 12:03:18,239 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(310): Store=b74578a527e8a472b5e0eb8682764b58/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:18,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fb0dff0e70a5d13ebabc7d0c10b510bd, NAME => 'testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 12:03:18,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:18,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:18,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:18,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:18,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:18,241 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:18,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,243 DEBUG [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1 2023-02-12 12:03:18,243 DEBUG [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1 2023-02-12 12:03:18,243 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb0dff0e70a5d13ebabc7d0c10b510bd columnFamilyName f1 2023-02-12 12:03:18,244 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(310): Store=fb0dff0e70a5d13ebabc7d0c10b510bd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,244 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:18,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:18,245 DEBUG [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2 2023-02-12 12:03:18,245 DEBUG [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2 2023-02-12 12:03:18,246 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb0dff0e70a5d13ebabc7d0c10b510bd columnFamilyName f2 2023-02-12 12:03:18,246 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(310): Store=fb0dff0e70a5d13ebabc7d0c10b510bd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:18,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:18,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b74578a527e8a472b5e0eb8682764b58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75129102, jitterRate=0.11951085925102234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b74578a527e8a472b5e0eb8682764b58: Running coprocessor pre-open hook at 1676203398232Writing region info on filesystem at 1676203398232Initializing all the Stores at 1676203398233 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398233Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398233Cleaning up temporary data from old regions at 1676203398241 (+8 ms)Cleaning up detritus from prior splits at 1676203398241Running coprocessor post-open hooks at 1676203398248 (+7 ms)Region opened successfully at 1676203398248 2023-02-12 12:03:18,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58., pid=21, masterSystemTime=1676203398227 2023-02-12 12:03:18,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:18,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:18,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:18,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dd7eac03420b5d08ba5e8ed75de2df7e, NAME => 'testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 12:03:18,251 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b74578a527e8a472b5e0eb8682764b58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:18,252 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398251"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398251"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398251"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398251"}]},"ts":"1676203398251"} 2023-02-12 12:03:18,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:18,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:18,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-12 12:03:18,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure b74578a527e8a472b5e0eb8682764b58, server=jenkins-hbase4.apache.org,45149,1676203395383 in 180 msec 2023-02-12 12:03:18,257 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b74578a527e8a472b5e0eb8682764b58, ASSIGN in 342 msec 2023-02-12 12:03:18,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:18,260 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:18,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fb0dff0e70a5d13ebabc7d0c10b510bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68092167, jitterRate=0.014652356505393982}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fb0dff0e70a5d13ebabc7d0c10b510bd: Running coprocessor pre-open hook at 1676203398240Writing region info on filesystem at 1676203398240Initializing all the Stores at 1676203398241 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398241Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398241Cleaning up temporary data from old regions at 1676203398249 (+8 ms)Cleaning up detritus from prior splits at 1676203398249Running coprocessor post-open hooks at 1676203398261 (+12 ms)Region opened successfully at 1676203398261 2023-02-12 12:03:18,261 DEBUG [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1 2023-02-12 12:03:18,261 DEBUG [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1 2023-02-12 12:03:18,262 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd7eac03420b5d08ba5e8ed75de2df7e columnFamilyName f1 2023-02-12 12:03:18,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd., pid=26, masterSystemTime=1676203398236 2023-02-12 12:03:18,263 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(310): Store=dd7eac03420b5d08ba5e8ed75de2df7e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,263 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:18,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:18,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:18,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:18,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 73ac448467573948a815516a288a05fc, NAME => 'testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 12:03:18,264 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fb0dff0e70a5d13ebabc7d0c10b510bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,264 DEBUG [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2 2023-02-12 12:03:18,264 DEBUG [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2 2023-02-12 12:03:18,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 73ac448467573948a815516a288a05fc 2023-02-12 12:03:18,264 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398264"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398264"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398264"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398264"}]},"ts":"1676203398264"} 2023-02-12 12:03:18,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 73ac448467573948a815516a288a05fc 2023-02-12 12:03:18,264 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd7eac03420b5d08ba5e8ed75de2df7e columnFamilyName f2 2023-02-12 12:03:18,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 73ac448467573948a815516a288a05fc 2023-02-12 12:03:18,265 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(310): Store=dd7eac03420b5d08ba5e8ed75de2df7e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:18,266 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 73ac448467573948a815516a288a05fc 2023-02-12 12:03:18,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:18,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=16 2023-02-12 12:03:18,268 DEBUG [StoreOpener-73ac448467573948a815516a288a05fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1 2023-02-12 12:03:18,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=16, state=SUCCESS; OpenRegionProcedure fb0dff0e70a5d13ebabc7d0c10b510bd, server=jenkins-hbase4.apache.org,38959,1676203395348 in 185 msec 2023-02-12 12:03:18,268 DEBUG [StoreOpener-73ac448467573948a815516a288a05fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1 2023-02-12 12:03:18,268 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73ac448467573948a815516a288a05fc columnFamilyName f1 2023-02-12 12:03:18,269 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(310): Store=73ac448467573948a815516a288a05fc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,269 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 73ac448467573948a815516a288a05fc 2023-02-12 12:03:18,270 DEBUG [StoreOpener-73ac448467573948a815516a288a05fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2 2023-02-12 12:03:18,270 DEBUG [StoreOpener-73ac448467573948a815516a288a05fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2 2023-02-12 12:03:18,271 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73ac448467573948a815516a288a05fc columnFamilyName f2 2023-02-12 12:03:18,271 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(310): Store=73ac448467573948a815516a288a05fc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,272 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fb0dff0e70a5d13ebabc7d0c10b510bd, ASSIGN in 354 msec 2023-02-12 12:03:18,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc 2023-02-12 12:03:18,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc 2023-02-12 12:03:18,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:18,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 73ac448467573948a815516a288a05fc 2023-02-12 12:03:18,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dd7eac03420b5d08ba5e8ed75de2df7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73444939, jitterRate=0.09441487491130829}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dd7eac03420b5d08ba5e8ed75de2df7e: Running coprocessor pre-open hook at 1676203398252Writing region info on filesystem at 1676203398252Initializing all the Stores at 1676203398253 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398254 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398260 (+6 ms)Cleaning up temporary data from old regions at 1676203398268 (+8 ms)Cleaning up detritus from prior splits at 1676203398272 (+4 ms)Running coprocessor post-open hooks at 1676203398281 (+9 ms)Region opened successfully at 1676203398281 2023-02-12 12:03:18,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 73ac448467573948a815516a288a05fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61264555, jitterRate=-0.0870869904756546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e., pid=24, masterSystemTime=1676203398227 2023-02-12 12:03:18,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 73ac448467573948a815516a288a05fc: Running coprocessor pre-open hook at 1676203398265Writing region info on filesystem at 1676203398265Initializing all the Stores at 1676203398266 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398266Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398266Cleaning up temporary data from old regions at 1676203398273 (+7 ms)Cleaning up detritus from prior splits at 1676203398274 (+1 ms)Running coprocessor post-open hooks at 1676203398281 (+7 ms)Region opened successfully at 1676203398281 2023-02-12 12:03:18,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc., pid=28, masterSystemTime=1676203398236 2023-02-12 12:03:18,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:18,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:18,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:18,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ae9f25198523ff4989772be17b20b711, NAME => 'testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 12:03:18,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:18,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:18,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:18,285 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=dd7eac03420b5d08ba5e8ed75de2df7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,285 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398285"}]},"ts":"1676203398285"} 2023-02-12 12:03:18,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:18,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:18,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:18,286 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=73ac448467573948a815516a288a05fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 349509f1216b0a92a12cfc3d7115404a, NAME => 'testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 12:03:18,286 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398285"}]},"ts":"1676203398285"} 2023-02-12 12:03:18,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:18,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:18,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:18,286 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:18,288 DEBUG [StoreOpener-ae9f25198523ff4989772be17b20b711-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1 2023-02-12 12:03:18,288 DEBUG [StoreOpener-ae9f25198523ff4989772be17b20b711-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1 2023-02-12 12:03:18,289 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:18,289 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae9f25198523ff4989772be17b20b711 columnFamilyName f1 2023-02-12 12:03:18,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-12 12:03:18,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure dd7eac03420b5d08ba5e8ed75de2df7e, server=jenkins-hbase4.apache.org,45149,1676203395383 in 210 msec 2023-02-12 12:03:18,290 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(310): Store=ae9f25198523ff4989772be17b20b711/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,290 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:18,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-12 12:03:18,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 73ac448467573948a815516a288a05fc, server=jenkins-hbase4.apache.org,38959,1676203395348 in 199 msec 2023-02-12 12:03:18,291 DEBUG [StoreOpener-ae9f25198523ff4989772be17b20b711-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2 2023-02-12 12:03:18,291 DEBUG [StoreOpener-ae9f25198523ff4989772be17b20b711-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2 2023-02-12 12:03:18,291 DEBUG [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a/f1 2023-02-12 12:03:18,291 DEBUG [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a/f1 2023-02-12 12:03:18,292 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae9f25198523ff4989772be17b20b711 columnFamilyName f2 2023-02-12 12:03:18,292 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 349509f1216b0a92a12cfc3d7115404a columnFamilyName f1 2023-02-12 12:03:18,292 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(310): Store=ae9f25198523ff4989772be17b20b711/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,292 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] regionserver.HStore(310): Store=349509f1216b0a92a12cfc3d7115404a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dd7eac03420b5d08ba5e8ed75de2df7e, ASSIGN in 375 msec 2023-02-12 12:03:18,293 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:18,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=73ac448467573948a815516a288a05fc, ASSIGN in 377 msec 2023-02-12 12:03:18,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:18,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:18,295 DEBUG [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a/f2 2023-02-12 12:03:18,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:18,295 DEBUG [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a/f2 2023-02-12 12:03:18,296 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 349509f1216b0a92a12cfc3d7115404a columnFamilyName f2 2023-02-12 12:03:18,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,296 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] regionserver.HStore(310): Store=349509f1216b0a92a12cfc3d7115404a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:18,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:18,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:18,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:18,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ae9f25198523ff4989772be17b20b711; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65425036, jitterRate=-0.02509099245071411}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ae9f25198523ff4989772be17b20b711: Running coprocessor pre-open hook at 1676203398284Writing region info on filesystem at 1676203398284Initializing all the Stores at 1676203398286 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398286Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398286Cleaning up temporary data from old regions at 1676203398295 (+9 ms)Cleaning up detritus from prior splits at 1676203398295Running coprocessor post-open hooks at 1676203398309 (+14 ms)Region opened successfully at 1676203398309 2023-02-12 12:03:18,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 349509f1216b0a92a12cfc3d7115404a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60434892, jitterRate=-0.09944993257522583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 349509f1216b0a92a12cfc3d7115404a: Running coprocessor pre-open hook at 1676203398286Writing region info on filesystem at 1676203398286Initializing all the Stores at 1676203398287 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398288 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398288Cleaning up temporary data from old regions at 1676203398299 (+11 ms)Cleaning up detritus from prior splits at 1676203398299Running coprocessor post-open hooks at 1676203398310 (+11 ms)Region opened successfully at 1676203398310 2023-02-12 12:03:18,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711., pid=25, masterSystemTime=1676203398227 2023-02-12 12:03:18,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a., pid=27, masterSystemTime=1676203398236 2023-02-12 12:03:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:18,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:18,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2d075e1d85beb58c0572d12964b34a20, NAME => 'testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 12:03:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:18,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:18,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:18,314 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ae9f25198523ff4989772be17b20b711, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:18,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:18,315 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398314"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398314"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398314"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398314"}]},"ts":"1676203398314"} 2023-02-12 12:03:18,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9fdbdad26d3d788587798ebf73be17d4, NAME => 'testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 12:03:18,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:18,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,315 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=349509f1216b0a92a12cfc3d7115404a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,315 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203398315"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398315"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398315"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398315"}]},"ts":"1676203398315"} 2023-02-12 12:03:18,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:18,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:18,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=14 2023-02-12 12:03:18,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=14, state=SUCCESS; OpenRegionProcedure ae9f25198523ff4989772be17b20b711, server=jenkins-hbase4.apache.org,45149,1676203395383 in 238 msec 2023-02-12 12:03:18,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-12 12:03:18,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 349509f1216b0a92a12cfc3d7115404a, server=jenkins-hbase4.apache.org,38959,1676203395348 in 233 msec 2023-02-12 12:03:18,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ae9f25198523ff4989772be17b20b711, ASSIGN in 405 msec 2023-02-12 12:03:18,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=349509f1216b0a92a12cfc3d7115404a, ASSIGN in 406 msec 2023-02-12 12:03:18,326 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:18,326 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:18,328 DEBUG [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1 2023-02-12 12:03:18,328 DEBUG [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1 2023-02-12 12:03:18,328 DEBUG [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20/f1 2023-02-12 12:03:18,328 DEBUG [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20/f1 2023-02-12 12:03:18,329 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fdbdad26d3d788587798ebf73be17d4 columnFamilyName f1 2023-02-12 12:03:18,329 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d075e1d85beb58c0572d12964b34a20 columnFamilyName f1 2023-02-12 12:03:18,329 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(310): Store=9fdbdad26d3d788587798ebf73be17d4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,329 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:18,329 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] regionserver.HStore(310): Store=2d075e1d85beb58c0572d12964b34a20/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,330 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:18,331 DEBUG [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2 2023-02-12 12:03:18,331 DEBUG [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2 2023-02-12 12:03:18,331 DEBUG [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20/f2 2023-02-12 12:03:18,331 DEBUG [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20/f2 2023-02-12 12:03:18,331 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fdbdad26d3d788587798ebf73be17d4 columnFamilyName f2 2023-02-12 12:03:18,331 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d075e1d85beb58c0572d12964b34a20 columnFamilyName f2 2023-02-12 12:03:18,332 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(310): Store=9fdbdad26d3d788587798ebf73be17d4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,332 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] regionserver.HStore(310): Store=2d075e1d85beb58c0572d12964b34a20/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:18,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:18,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:18,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:18,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:18,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:18,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2d075e1d85beb58c0572d12964b34a20; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60190232, jitterRate=-0.1030956506729126}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2d075e1d85beb58c0572d12964b34a20: Running coprocessor pre-open hook at 1676203398314Writing region info on filesystem at 1676203398314Initializing all the Stores at 1676203398315 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398315Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398326 (+11 ms)Cleaning up temporary data from old regions at 1676203398334 (+8 ms)Cleaning up detritus from prior splits at 1676203398335 (+1 ms)Running coprocessor post-open hooks at 1676203398340 (+5 ms)Region opened successfully at 1676203398340 2023-02-12 12:03:18,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9fdbdad26d3d788587798ebf73be17d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75176865, jitterRate=0.12022258341312408}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9fdbdad26d3d788587798ebf73be17d4: Running coprocessor pre-open hook at 1676203398316Writing region info on filesystem at 1676203398316Initializing all the Stores at 1676203398316Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398317 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398326 (+9 ms)Cleaning up temporary data from old regions at 1676203398334 (+8 ms)Cleaning up detritus from prior splits at 1676203398334Running coprocessor post-open hooks at 1676203398340 (+6 ms)Region opened successfully at 1676203398340 2023-02-12 12:03:18,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20., pid=22, masterSystemTime=1676203398227 2023-02-12 12:03:18,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4., pid=29, masterSystemTime=1676203398236 2023-02-12 12:03:18,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:18,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:18,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:18,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7c935bb96b6eefe3d9f88a5f3c0c47f3, NAME => 'testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 12:03:18,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:18,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:18,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:18,343 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2d075e1d85beb58c0572d12964b34a20, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,344 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676203398343"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398343"}]},"ts":"1676203398343"} 2023-02-12 12:03:18,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:18,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:18,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:18,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d06b98edd97b470ebe5c7bd4dc373b7f, NAME => 'testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 12:03:18,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:18,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:18,345 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9fdbdad26d3d788587798ebf73be17d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:18,345 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398345"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398345"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398345"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398345"}]},"ts":"1676203398345"} 2023-02-12 12:03:18,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:18,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=20 2023-02-12 12:03:18,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=20, state=SUCCESS; OpenRegionProcedure 2d075e1d85beb58c0572d12964b34a20, server=jenkins-hbase4.apache.org,45149,1676203395383 in 271 msec 2023-02-12 12:03:18,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-12 12:03:18,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2d075e1d85beb58c0572d12964b34a20, ASSIGN in 434 msec 2023-02-12 12:03:18,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure 9fdbdad26d3d788587798ebf73be17d4, server=jenkins-hbase4.apache.org,38959,1676203395348 in 257 msec 2023-02-12 12:03:18,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9fdbdad26d3d788587798ebf73be17d4, ASSIGN in 435 msec 2023-02-12 12:03:18,352 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:18,352 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:18,353 DEBUG [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1 2023-02-12 12:03:18,353 DEBUG [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1 2023-02-12 12:03:18,353 DEBUG [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1 2023-02-12 12:03:18,353 DEBUG [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1 2023-02-12 12:03:18,354 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c935bb96b6eefe3d9f88a5f3c0c47f3 columnFamilyName f1 2023-02-12 12:03:18,354 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d06b98edd97b470ebe5c7bd4dc373b7f columnFamilyName f1 2023-02-12 12:03:18,354 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(310): Store=7c935bb96b6eefe3d9f88a5f3c0c47f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,354 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:18,354 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(310): Store=d06b98edd97b470ebe5c7bd4dc373b7f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,354 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:18,355 DEBUG [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2 2023-02-12 12:03:18,355 DEBUG [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2 2023-02-12 12:03:18,356 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c935bb96b6eefe3d9f88a5f3c0c47f3 columnFamilyName f2 2023-02-12 12:03:18,356 DEBUG [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2 2023-02-12 12:03:18,356 DEBUG [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2 2023-02-12 12:03:18,356 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d06b98edd97b470ebe5c7bd4dc373b7f columnFamilyName f2 2023-02-12 12:03:18,356 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(310): Store=7c935bb96b6eefe3d9f88a5f3c0c47f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:18,357 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(310): Store=d06b98edd97b470ebe5c7bd4dc373b7f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:18,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:18,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:18,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:18,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:18,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:18,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d06b98edd97b470ebe5c7bd4dc373b7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67800713, jitterRate=0.010309353470802307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d06b98edd97b470ebe5c7bd4dc373b7f: Running coprocessor pre-open hook at 1676203398345Writing region info on filesystem at 1676203398345Initializing all the Stores at 1676203398347 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398347Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398352 (+5 ms)Cleaning up temporary data from old regions at 1676203398360 (+8 ms)Cleaning up detritus from prior splits at 1676203398360Running coprocessor post-open hooks at 1676203398365 (+5 ms)Region opened successfully at 1676203398365 2023-02-12 12:03:18,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:18,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f., pid=30, masterSystemTime=1676203398236 2023-02-12 12:03:18,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:18,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:18,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:18,368 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=d06b98edd97b470ebe5c7bd4dc373b7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:18,368 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398368"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398368"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398368"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398368"}]},"ts":"1676203398368"} 2023-02-12 12:03:18,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7c935bb96b6eefe3d9f88a5f3c0c47f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67064167, jitterRate=-6.660372018814087E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:18,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7c935bb96b6eefe3d9f88a5f3c0c47f3: Running coprocessor pre-open hook at 1676203398343Writing region info on filesystem at 1676203398343Initializing all the Stores at 1676203398344 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398344Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203398352 (+8 ms)Cleaning up temporary data from old regions at 1676203398358 (+6 ms)Cleaning up detritus from prior splits at 1676203398359 (+1 ms)Running coprocessor post-open hooks at 1676203398368 (+9 ms)Region opened successfully at 1676203398369 (+1 ms) 2023-02-12 12:03:18,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3., pid=23, masterSystemTime=1676203398227 2023-02-12 12:03:18,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:18,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:18,371 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=7c935bb96b6eefe3d9f88a5f3c0c47f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:18,372 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676203398371"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203398371"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203398371"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203398371"}]},"ts":"1676203398371"} 2023-02-12 12:03:18,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-12 12:03:18,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure d06b98edd97b470ebe5c7bd4dc373b7f, server=jenkins-hbase4.apache.org,38959,1676203395348 in 279 msec 2023-02-12 12:03:18,373 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d06b98edd97b470ebe5c7bd4dc373b7f, ASSIGN in 458 msec 2023-02-12 12:03:18,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-12 12:03:18,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 7c935bb96b6eefe3d9f88a5f3c0c47f3, server=jenkins-hbase4.apache.org,45149,1676203395383 in 296 msec 2023-02-12 12:03:18,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-12 12:03:18,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7c935bb96b6eefe3d9f88a5f3c0c47f3, ASSIGN in 461 msec 2023-02-12 12:03:18,378 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:18,378 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203398378"}]},"ts":"1676203398378"} 2023-02-12 12:03:18,379 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 12:03:18,420 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:18,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 736 msec 2023-02-12 12:03:18,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:18,797 INFO [Listener at localhost/42921] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 12:03:18,797 DEBUG [Listener at localhost/42921] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 12:03:18,798 INFO [Listener at localhost/42921] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:18,802 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 12:03:18,803 INFO [Listener at localhost/42921] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:18,803 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 12:03:18,803 INFO [Listener at localhost/42921] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 12:03:18,874 DEBUG [hconnection-0x4387c1f2-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:18,897 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38959] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:18,899 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43146, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:18,908 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45149] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:19,010 INFO [Listener at localhost/42921] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 12:03:19,011 INFO [Listener at localhost/42921] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 12:03:19,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 12:03:19,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676203399012 (current time:1676203399012). 2023-02-12 12:03:19,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 12:03:19,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] zookeeper.ReadOnlyZKClient(139): Connect 0x4e9ebe79 to 127.0.0.1:62210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:19,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52fa2ae9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:19,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:19,052 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42178, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:19,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e9ebe79 to 127.0.0.1:62210 2023-02-12 12:03:19,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:19,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 12:03:19,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 12:03:19,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 12:03:19,058 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 12:03:19,059 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676203999059 2023-02-12 12:03:19,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 12:03:19,068 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 12:03:19,081 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:19,081 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 12:03:19,081 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 12:03:19,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 12:03:19,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 26 msec 2023-02-12 12:03:19,084 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 12:03:19,085 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676203999085 2023-02-12 12:03:19,182 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:19,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:19,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:19,184 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 12:03:19,384 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:19,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:19,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:19,386 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 12:03:19,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,524 INFO [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-12 12:03:19,524 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:19,524 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-12 12:03:19,524 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-12 12:03:19,525 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,525 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,527 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:19,527 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:19,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:19,527 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:19,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,527 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,527 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,528 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:19,528 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,528 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 12:03:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 12:03:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 12:03:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 12:03:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38959,1676203395348' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 12:03:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:19,530 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 12:03:19,530 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 12:03:19,530 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1676203395383' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 12:03:19,532 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:19,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:19,534 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:19,534 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,534 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:19,534 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:19,535 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,535 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:19,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:19,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38959,1676203395348' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 12:03:19,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66ff5f94[Count = 1] remaining members to acquire global barrier 2023-02-12 12:03:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:19,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:19,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:19,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1676203395383' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 12:03:19,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66ff5f94[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:19,539 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-12 12:03:19,539 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,540 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,540 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,540 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 12:03:19,540 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 12:03:19,540 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:19,541 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:19,541 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. started... 2023-02-12 12:03:19,541 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:19,541 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:19,541 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. started... 2023-02-12 12:03:19,541 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. started... 2023-02-12 12:03:19,541 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:19,541 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:19,545 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 349509f1216b0a92a12cfc3d7115404a: 2023-02-12 12:03:19,545 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 12:03:19,545 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:19,545 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:19,545 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b74578a527e8a472b5e0eb8682764b58 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 12:03:19,546 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. started... 2023-02-12 12:03:19,545 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,546 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ae9f25198523ff4989772be17b20b711 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:19,546 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 73ac448467573948a815516a288a05fc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:19,545 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:19,545 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:19,545 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 12:03:19,547 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:19,547 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. started... 2023-02-12 12:03:19,547 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. started... 2023-02-12 12:03:19,548 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] regionserver.HRegion(2744): Flushing dd7eac03420b5d08ba5e8ed75de2df7e 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 12:03:19,546 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:19,549 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d06b98edd97b470ebe5c7bd4dc373b7f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:19,549 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:19,549 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:19,604 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. completed. 2023-02-12 12:03:19,605 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:19,605 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:19,605 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 12:03:19,605 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. started... 2023-02-12 12:03:19,609 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fb0dff0e70a5d13ebabc7d0c10b510bd 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:19,620 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/.tmp/f1/853d53dbc17f4ad7bb4baf311f9e2cc2 2023-02-12 12:03:19,632 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/.tmp/f1/217931233a5448eba149b57365b95f6b 2023-02-12 12:03:19,643 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/.tmp/f1/82d9f99f0fe14f149dbee92c058a51bc 2023-02-12 12:03:19,655 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/.tmp/f1/204a296b97c447cbba598c7baaa5317b 2023-02-12 12:03:19,686 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:19,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:19,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:19,688 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 12:03:19,690 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/.tmp/f1/c7908d60a3db463f96af4329c9060a58 2023-02-12 12:03:19,709 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/.tmp/f2/648c72733aba4d84ab19af57edef89a3 2023-02-12 12:03:19,715 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/.tmp/f1/853d53dbc17f4ad7bb4baf311f9e2cc2 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1/853d53dbc17f4ad7bb4baf311f9e2cc2 2023-02-12 12:03:19,721 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1/853d53dbc17f4ad7bb4baf311f9e2cc2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:19,722 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/.tmp/f2/648c72733aba4d84ab19af57edef89a3 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2/648c72733aba4d84ab19af57edef89a3 2023-02-12 12:03:19,743 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2/648c72733aba4d84ab19af57edef89a3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:19,745 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for b74578a527e8a472b5e0eb8682764b58 in 200ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:19,745 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 12:03:19,746 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b74578a527e8a472b5e0eb8682764b58: 2023-02-12 12:03:19,746 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,746 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:19,746 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1/853d53dbc17f4ad7bb4baf311f9e2cc2] hfiles 2023-02-12 12:03:19,746 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1/853d53dbc17f4ad7bb4baf311f9e2cc2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,746 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2/648c72733aba4d84ab19af57edef89a3] hfiles 2023-02-12 12:03:19,746 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2/648c72733aba4d84ab19af57edef89a3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,748 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/.tmp/f2/337244d18a9a4ff790bef0474d9b6a43 2023-02-12 12:03:19,755 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/.tmp/f2/b7121d83a63c4a7e9986aed442858831 2023-02-12 12:03:19,760 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/.tmp/f1/82d9f99f0fe14f149dbee92c058a51bc as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1/82d9f99f0fe14f149dbee92c058a51bc 2023-02-12 12:03:19,762 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/.tmp/f1/217931233a5448eba149b57365b95f6b as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1/217931233a5448eba149b57365b95f6b 2023-02-12 12:03:19,768 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1/217931233a5448eba149b57365b95f6b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:19,771 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/.tmp/f2/b7121d83a63c4a7e9986aed442858831 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2/b7121d83a63c4a7e9986aed442858831 2023-02-12 12:03:19,781 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1/82d9f99f0fe14f149dbee92c058a51bc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:19,781 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2/b7121d83a63c4a7e9986aed442858831, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:19,782 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/.tmp/f2/337244d18a9a4ff790bef0474d9b6a43 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2/337244d18a9a4ff790bef0474d9b6a43 2023-02-12 12:03:19,783 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 73ac448467573948a815516a288a05fc in 237ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:19,797 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 73ac448467573948a815516a288a05fc: 2023-02-12 12:03:19,797 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,797 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:19,797 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1/217931233a5448eba149b57365b95f6b] hfiles 2023-02-12 12:03:19,797 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1/217931233a5448eba149b57365b95f6b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,797 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2/b7121d83a63c4a7e9986aed442858831] hfiles 2023-02-12 12:03:19,797 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2/b7121d83a63c4a7e9986aed442858831 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,800 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2/337244d18a9a4ff790bef0474d9b6a43, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:19,801 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ae9f25198523ff4989772be17b20b711 in 256ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:19,801 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ae9f25198523ff4989772be17b20b711: 2023-02-12 12:03:19,801 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,801 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:19,802 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1/82d9f99f0fe14f149dbee92c058a51bc] hfiles 2023-02-12 12:03:19,802 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1/82d9f99f0fe14f149dbee92c058a51bc for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,802 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2/337244d18a9a4ff790bef0474d9b6a43] hfiles 2023-02-12 12:03:19,802 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2/337244d18a9a4ff790bef0474d9b6a43 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,815 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. completed. 2023-02-12 12:03:19,815 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:19,815 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:19,815 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 12:03:19,815 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. started... 2023-02-12 12:03:19,816 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2d075e1d85beb58c0572d12964b34a20: 2023-02-12 12:03:19,816 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,816 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:19,816 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:19,816 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:19,831 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. completed. 2023-02-12 12:03:19,831 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:19,831 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:19,831 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. started... 2023-02-12 12:03:19,831 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9fdbdad26d3d788587798ebf73be17d4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:19,832 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 12:03:19,840 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. completed. 2023-02-12 12:03:19,840 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:19,841 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:19,841 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 12:03:19,841 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. started... 2023-02-12 12:03:19,841 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7c935bb96b6eefe3d9f88a5f3c0c47f3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:19,861 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/.tmp/f1/38cb989e413748828b57abb849a0f35c 2023-02-12 12:03:19,870 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/.tmp/f1/b4cec6a640b440189a04cc23da7d4ca2 2023-02-12 12:03:19,897 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/.tmp/f2/39a939bd96a5498d95c077c3dea73e7f 2023-02-12 12:03:19,903 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/.tmp/f1/38cb989e413748828b57abb849a0f35c as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1/38cb989e413748828b57abb849a0f35c 2023-02-12 12:03:19,907 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/.tmp/f2/af4003b1f0ca406cad430ec6c317971e 2023-02-12 12:03:19,909 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1/38cb989e413748828b57abb849a0f35c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:19,910 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/.tmp/f2/39a939bd96a5498d95c077c3dea73e7f as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2/39a939bd96a5498d95c077c3dea73e7f 2023-02-12 12:03:19,913 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/.tmp/f1/b4cec6a640b440189a04cc23da7d4ca2 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1/b4cec6a640b440189a04cc23da7d4ca2 2023-02-12 12:03:19,915 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2/39a939bd96a5498d95c077c3dea73e7f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:19,916 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9fdbdad26d3d788587798ebf73be17d4 in 85ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:19,916 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9fdbdad26d3d788587798ebf73be17d4: 2023-02-12 12:03:19,916 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,916 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:19,916 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1/38cb989e413748828b57abb849a0f35c] hfiles 2023-02-12 12:03:19,916 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1/38cb989e413748828b57abb849a0f35c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,917 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2/39a939bd96a5498d95c077c3dea73e7f] hfiles 2023-02-12 12:03:19,917 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2/39a939bd96a5498d95c077c3dea73e7f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,919 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1/b4cec6a640b440189a04cc23da7d4ca2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:19,920 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/.tmp/f2/af4003b1f0ca406cad430ec6c317971e as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2/af4003b1f0ca406cad430ec6c317971e 2023-02-12 12:03:19,928 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. completed. 2023-02-12 12:03:19,928 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:19,928 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 12:03:19,929 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2/af4003b1f0ca406cad430ec6c317971e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:19,930 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7c935bb96b6eefe3d9f88a5f3c0c47f3 in 89ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:19,930 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7c935bb96b6eefe3d9f88a5f3c0c47f3: 2023-02-12 12:03:19,930 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,930 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:19,930 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1/b4cec6a640b440189a04cc23da7d4ca2] hfiles 2023-02-12 12:03:19,930 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1/b4cec6a640b440189a04cc23da7d4ca2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,930 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2/af4003b1f0ca406cad430ec6c317971e] hfiles 2023-02-12 12:03:19,930 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2/af4003b1f0ca406cad430ec6c317971e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:19,942 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. completed. 2023-02-12 12:03:19,942 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:19,942 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 12:03:20,056 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/.tmp/f1/f05ad870a7b24d65a75e1c6fcd2dda48 2023-02-12 12:03:20,075 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/.tmp/f2/81cf0b483e9b4143be60f0b1481f582b 2023-02-12 12:03:20,080 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/.tmp/f1/f05ad870a7b24d65a75e1c6fcd2dda48 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1/f05ad870a7b24d65a75e1c6fcd2dda48 2023-02-12 12:03:20,085 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1/f05ad870a7b24d65a75e1c6fcd2dda48, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:20,086 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/.tmp/f2/81cf0b483e9b4143be60f0b1481f582b as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2/81cf0b483e9b4143be60f0b1481f582b 2023-02-12 12:03:20,091 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2/81cf0b483e9b4143be60f0b1481f582b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:20,092 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for dd7eac03420b5d08ba5e8ed75de2df7e in 544ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:20,092 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for dd7eac03420b5d08ba5e8ed75de2df7e: 2023-02-12 12:03:20,092 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,092 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:20,092 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1/f05ad870a7b24d65a75e1c6fcd2dda48] hfiles 2023-02-12 12:03:20,092 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1/f05ad870a7b24d65a75e1c6fcd2dda48 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,092 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2/81cf0b483e9b4143be60f0b1481f582b] hfiles 2023-02-12 12:03:20,092 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2/81cf0b483e9b4143be60f0b1481f582b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,105 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. completed. 2023-02-12 12:03:20,105 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:20,105 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 12:03:20,153 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/.tmp/f2/bc39f33fe37d417a869101ec85766890 2023-02-12 12:03:20,160 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/.tmp/f1/204a296b97c447cbba598c7baaa5317b as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1/204a296b97c447cbba598c7baaa5317b 2023-02-12 12:03:20,165 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1/204a296b97c447cbba598c7baaa5317b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:20,166 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/.tmp/f2/bc39f33fe37d417a869101ec85766890 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2/bc39f33fe37d417a869101ec85766890 2023-02-12 12:03:20,171 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/.tmp/f2/1636dda6d3b6408ab7e7f6a7af65391c 2023-02-12 12:03:20,171 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2/bc39f33fe37d417a869101ec85766890, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:20,172 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d06b98edd97b470ebe5c7bd4dc373b7f in 624ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:20,173 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d06b98edd97b470ebe5c7bd4dc373b7f: 2023-02-12 12:03:20,173 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,173 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:20,173 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1/204a296b97c447cbba598c7baaa5317b] hfiles 2023-02-12 12:03:20,173 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1/204a296b97c447cbba598c7baaa5317b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,173 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2/bc39f33fe37d417a869101ec85766890] hfiles 2023-02-12 12:03:20,173 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2/bc39f33fe37d417a869101ec85766890 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,177 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/.tmp/f1/c7908d60a3db463f96af4329c9060a58 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1/c7908d60a3db463f96af4329c9060a58 2023-02-12 12:03:20,188 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:20,188 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. completed. 2023-02-12 12:03:20,188 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:20,188 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 12:03:20,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:20,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:20,190 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-12 12:03:20,191 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1/c7908d60a3db463f96af4329c9060a58, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:20,192 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/.tmp/f2/1636dda6d3b6408ab7e7f6a7af65391c as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2/1636dda6d3b6408ab7e7f6a7af65391c 2023-02-12 12:03:20,198 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2/1636dda6d3b6408ab7e7f6a7af65391c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:20,199 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for fb0dff0e70a5d13ebabc7d0c10b510bd in 590ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:20,199 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fb0dff0e70a5d13ebabc7d0c10b510bd: 2023-02-12 12:03:20,199 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,199 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:20,200 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1/c7908d60a3db463f96af4329c9060a58] hfiles 2023-02-12 12:03:20,200 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1/c7908d60a3db463f96af4329c9060a58 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,200 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2/1636dda6d3b6408ab7e7f6a7af65391c] hfiles 2023-02-12 12:03:20,200 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2/1636dda6d3b6408ab7e7f6a7af65391c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,212 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. completed. 2023-02-12 12:03:20,212 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:20,212 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 12:03:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 12:03:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 12:03:20,213 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,38959,1676203395348' in zk 2023-02-12 12:03:20,215 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 12:03:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:20,215 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 12:03:20,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:20,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,38959,1676203395348': 2023-02-12 12:03:20,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38959,1676203395348' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 12:03:20,232 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. completed. 2023-02-12 12:03:20,232 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 12:03:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 12:03:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 12:03:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,45149,1676203395383' in zk 2023-02-12 12:03:20,235 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 12:03:20,235 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,235 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:20,235 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 12:03:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,45149,1676203395383': 2023-02-12 12:03:20,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1676203395383' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 12:03:20,239 INFO [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-12 12:03:20,239 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:20,239 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:20,239 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,239 INFO [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 12:03:20,241 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,241 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,241 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:20,241 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,241 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:20,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:20,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:20,242 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,242 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,244 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:20,245 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,252 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,252 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:20,252 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:20,252 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,252 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:20,252 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,252 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:20,252 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:20,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:20,252 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:20,252 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,254 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:20,254 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,254 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:20,254 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:20,254 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:20,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:20,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:20,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-12 12:03:20,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,595 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:20,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676203399068Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676203400253 (+1185 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676203400254 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676203400276 (+22 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676203400293 (+17 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676203400594 (+301 ms) 2023-02-12 12:03:20,596 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 12:03:20,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.5160 sec 2023-02-12 12:03:21,190 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:21,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:21,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 12:03:21,192 INFO [Listener at localhost/42921] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 12:03:21,196 INFO [Listener at localhost/42921] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 12:03:21,204 INFO [Listener at localhost/42921] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 12:03:21,239 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38959] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:21,244 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45149] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:21,324 INFO [Listener at localhost/42921] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 12:03:21,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 12:03:21,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 12:03:21,334 INFO [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 12:03:21,334 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:21,335 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 12:03:21,335 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 12:03:21,335 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,335 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:21,337 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:21,337 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,337 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:21,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:21,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:21,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:21,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:21,337 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,338 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:21,338 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:21,338 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:21,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:21,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:21,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:21,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:21,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 12:03:21,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 12:03:21,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 12:03:21,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 12:03:21,339 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 12:03:21,339 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:21,339 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 12:03:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 12:03:21,340 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:21,341 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 12:03:21,341 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:21,341 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. started... 2023-02-12 12:03:21,341 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 349509f1216b0a92a12cfc3d7115404a: 2023-02-12 12:03:21,341 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:21,344 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:21,344 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:21,344 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. started... 2023-02-12 12:03:21,344 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. started... 2023-02-12 12:03:21,344 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d06b98edd97b470ebe5c7bd4dc373b7f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:21,344 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 73ac448467573948a815516a288a05fc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:21,344 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 12:03:21,345 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:21,345 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 12:03:21,345 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:21,345 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:21,345 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 12:03:21,345 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:21,346 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:21,346 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. started... 2023-02-12 12:03:21,345 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:21,346 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. started... 2023-02-12 12:03:21,346 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fb0dff0e70a5d13ebabc7d0c10b510bd 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:21,345 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. started... 2023-02-12 12:03:21,345 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. started... 2023-02-12 12:03:21,346 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ae9f25198523ff4989772be17b20b711 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:21,346 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b74578a527e8a472b5e0eb8682764b58 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 12:03:21,346 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing dd7eac03420b5d08ba5e8ed75de2df7e 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 12:03:21,386 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/.tmp/f1/263740b6dedb4f0193449ba8a564ce0b 2023-02-12 12:03:21,398 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/.tmp/f1/00e3c838cc7c4cdaa420599dd5040c24 2023-02-12 12:03:21,404 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/.tmp/f1/a0a52bfff6164ae8b61cdb7c73a0f545 2023-02-12 12:03:21,404 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/.tmp/f1/2d10f951ba0e4f3f83bd98080bcabb72 2023-02-12 12:03:21,407 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/.tmp/f1/c0334eca717c467abff13fcb06c3dc88 2023-02-12 12:03:21,412 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/.tmp/f1/4955646864fa49e788e12bc070f74ab4 2023-02-12 12:03:21,432 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/.tmp/f2/918b9f1792ae4e46ba89e69308166c3b 2023-02-12 12:03:21,437 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/.tmp/f1/263740b6dedb4f0193449ba8a564ce0b as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1/263740b6dedb4f0193449ba8a564ce0b 2023-02-12 12:03:21,443 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1/263740b6dedb4f0193449ba8a564ce0b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:21,444 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/.tmp/f2/918b9f1792ae4e46ba89e69308166c3b as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2/918b9f1792ae4e46ba89e69308166c3b 2023-02-12 12:03:21,448 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2/918b9f1792ae4e46ba89e69308166c3b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:21,449 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for b74578a527e8a472b5e0eb8682764b58 in 103ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:21,449 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b74578a527e8a472b5e0eb8682764b58: 2023-02-12 12:03:21,449 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:21,452 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:21,452 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 12:03:21,452 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. started... 2023-02-12 12:03:21,452 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2d075e1d85beb58c0572d12964b34a20: 2023-02-12 12:03:21,452 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:21,452 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:21,452 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 12:03:21,452 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. started... 2023-02-12 12:03:21,452 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7c935bb96b6eefe3d9f88a5f3c0c47f3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:21,476 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/.tmp/f2/fe9afafe37cb41c498d628f870ee9a3f 2023-02-12 12:03:21,479 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/.tmp/f2/67e2951191d1405fb65f058d9230c2cc 2023-02-12 12:03:21,479 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/.tmp/f2/daf06a0b1e224dd3a76c6fbe3c7bad0b 2023-02-12 12:03:21,487 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/.tmp/f1/2d10f951ba0e4f3f83bd98080bcabb72 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1/2d10f951ba0e4f3f83bd98080bcabb72 2023-02-12 12:03:21,487 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/.tmp/f1/00e3c838cc7c4cdaa420599dd5040c24 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1/00e3c838cc7c4cdaa420599dd5040c24 2023-02-12 12:03:21,492 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1/2d10f951ba0e4f3f83bd98080bcabb72, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,492 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1/00e3c838cc7c4cdaa420599dd5040c24, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,493 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/.tmp/f2/fe9afafe37cb41c498d628f870ee9a3f as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2/fe9afafe37cb41c498d628f870ee9a3f 2023-02-12 12:03:21,493 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/.tmp/f2/67e2951191d1405fb65f058d9230c2cc as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2/67e2951191d1405fb65f058d9230c2cc 2023-02-12 12:03:21,495 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/.tmp/f1/c0334eca717c467abff13fcb06c3dc88 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1/c0334eca717c467abff13fcb06c3dc88 2023-02-12 12:03:21,498 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2/67e2951191d1405fb65f058d9230c2cc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,499 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for fb0dff0e70a5d13ebabc7d0c10b510bd in 153ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:21,500 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fb0dff0e70a5d13ebabc7d0c10b510bd: 2023-02-12 12:03:21,500 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:21,500 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:21,500 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. started... 2023-02-12 12:03:21,500 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9fdbdad26d3d788587798ebf73be17d4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:21,500 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 12:03:21,501 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1/c0334eca717c467abff13fcb06c3dc88, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:21,502 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/.tmp/f2/daf06a0b1e224dd3a76c6fbe3c7bad0b as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2/daf06a0b1e224dd3a76c6fbe3c7bad0b 2023-02-12 12:03:21,504 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/.tmp/f2/3a538cebf7ea48ba9b8776c9e99085ee 2023-02-12 12:03:21,508 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/.tmp/f2/fda285567afa4870a6d05ef633be6a91 2023-02-12 12:03:21,514 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2/daf06a0b1e224dd3a76c6fbe3c7bad0b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:21,515 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for dd7eac03420b5d08ba5e8ed75de2df7e in 169ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:21,515 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for dd7eac03420b5d08ba5e8ed75de2df7e: 2023-02-12 12:03:21,515 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:21,515 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 12:03:21,517 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2/fe9afafe37cb41c498d628f870ee9a3f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,518 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ae9f25198523ff4989772be17b20b711 in 172ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:21,518 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ae9f25198523ff4989772be17b20b711: 2023-02-12 12:03:21,518 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:21,518 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 12:03:21,520 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/.tmp/f1/4efc2a19d8164be1934c501d45553962 2023-02-12 12:03:21,523 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/.tmp/f1/4955646864fa49e788e12bc070f74ab4 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1/4955646864fa49e788e12bc070f74ab4 2023-02-12 12:03:21,525 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/.tmp/f1/a0a52bfff6164ae8b61cdb7c73a0f545 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1/a0a52bfff6164ae8b61cdb7c73a0f545 2023-02-12 12:03:21,531 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1/4955646864fa49e788e12bc070f74ab4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,532 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/.tmp/f2/3a538cebf7ea48ba9b8776c9e99085ee as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2/3a538cebf7ea48ba9b8776c9e99085ee 2023-02-12 12:03:21,536 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2/3a538cebf7ea48ba9b8776c9e99085ee, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,538 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1/a0a52bfff6164ae8b61cdb7c73a0f545, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,539 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/.tmp/f2/fda285567afa4870a6d05ef633be6a91 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2/fda285567afa4870a6d05ef633be6a91 2023-02-12 12:03:21,540 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 73ac448467573948a815516a288a05fc in 196ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:21,540 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 73ac448467573948a815516a288a05fc: 2023-02-12 12:03:21,540 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:21,540 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 12:03:21,544 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2/fda285567afa4870a6d05ef633be6a91, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,545 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d06b98edd97b470ebe5c7bd4dc373b7f in 201ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:21,545 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d06b98edd97b470ebe5c7bd4dc373b7f: 2023-02-12 12:03:21,545 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:21,545 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 12:03:21,552 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/.tmp/f1/7affe443a7f448f990028d06823ec6b3 2023-02-12 12:03:21,556 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/.tmp/f2/51a882bc8d894ec6b6c41bb4f15de469 2023-02-12 12:03:21,561 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/.tmp/f1/4efc2a19d8164be1934c501d45553962 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1/4efc2a19d8164be1934c501d45553962 2023-02-12 12:03:21,567 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1/4efc2a19d8164be1934c501d45553962, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,568 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/.tmp/f2/51a882bc8d894ec6b6c41bb4f15de469 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2/51a882bc8d894ec6b6c41bb4f15de469 2023-02-12 12:03:21,576 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/.tmp/f2/0d8bfbe14ae3423fa58b7c440620e73e 2023-02-12 12:03:21,577 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2/51a882bc8d894ec6b6c41bb4f15de469, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,578 INFO [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7c935bb96b6eefe3d9f88a5f3c0c47f3 in 126ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:21,578 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7c935bb96b6eefe3d9f88a5f3c0c47f3: 2023-02-12 12:03:21,578 DEBUG [rs(jenkins-hbase4.apache.org,45149,1676203395383)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:21,578 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 12:03:21,578 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 12:03:21,578 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,578 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 12:03:21,578 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1676203395383' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 12:03:21,580 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,580 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:21,580 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:21,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:21,582 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/.tmp/f1/7affe443a7f448f990028d06823ec6b3 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1/7affe443a7f448f990028d06823ec6b3 2023-02-12 12:03:21,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1676203395383' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 12:03:21,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62c0c793[Count = 1] remaining members to acquire global barrier 2023-02-12 12:03:21,587 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1/7affe443a7f448f990028d06823ec6b3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,587 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/.tmp/f2/0d8bfbe14ae3423fa58b7c440620e73e as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2/0d8bfbe14ae3423fa58b7c440620e73e 2023-02-12 12:03:21,592 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2/0d8bfbe14ae3423fa58b7c440620e73e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:21,593 INFO [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9fdbdad26d3d788587798ebf73be17d4 in 93ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:21,593 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9fdbdad26d3d788587798ebf73be17d4: 2023-02-12 12:03:21,593 DEBUG [rs(jenkins-hbase4.apache.org,38959,1676203395348)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:21,593 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 12:03:21,593 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 12:03:21,593 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,593 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 12:03:21,593 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38959,1676203395348' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 12:03:21,595 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,595 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:21,595 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,595 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:21,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38959,1676203395348' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 12:03:21,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62c0c793[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:21,597 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 12:03:21,597 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,599 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,599 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,600 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 12:03:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 12:03:21,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,45149,1676203395383' in zk 2023-02-12 12:03:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 12:03:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 12:03:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38959,1676203395348' in zk 2023-02-12 12:03:21,600 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,600 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:21,601 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 12:03:21,601 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,601 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:21,602 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1676203395383' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 12:03:21,603 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,603 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 12:03:21,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:21,603 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:21,603 DEBUG [member: 'jenkins-hbase4.apache.org,38959,1676203395348' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 12:03:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,45149,1676203395383': 2023-02-12 12:03:21,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1676203395383' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 12:03:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:21,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38959,1676203395348': 2023-02-12 12:03:21,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38959,1676203395348' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 12:03:21,610 INFO [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 12:03:21,610 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:21,610 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:21,610 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 12:03:21,610 INFO [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 12:03:21,612 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,612 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,612 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,612 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:21,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:21,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:21,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,612 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:21,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:21,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:21,613 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:21,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:21,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:21,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,614 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:21,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:21,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,615 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:21,616 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:21,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,620 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:21,620 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:21,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:21,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:21,620 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 12:03:21,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 12:03:21,620 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:21,620 DEBUG [(jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:21,620 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:21,620 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:21,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:21,621 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:21,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:21,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:21,620 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,621 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 12:03:21,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:21,622 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:21,622 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,622 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,622 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,622 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:21,622 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:21,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:21,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:21,662 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 12:03:21,679 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 12:03:21,722 DEBUG [Listener at localhost/42921] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 12:03:21,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44927] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 12:03:21,724 INFO [Listener at localhost/42921] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 12:03:21,724 DEBUG [Listener at localhost/42921] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c6a4fc1 to 127.0.0.1:62210 2023-02-12 12:03:21,724 DEBUG [Listener at localhost/42921] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:21,725 DEBUG [Listener at localhost/42921] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 12:03:21,725 DEBUG [Listener at localhost/42921] util.JVMClusterUtil(257): Found active master hash=1878911959, stopped=false 2023-02-12 12:03:21,725 INFO [Listener at localhost/42921] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:21,727 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:21,727 INFO [Listener at localhost/42921] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 12:03:21,727 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:21,727 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:21,727 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:21,727 DEBUG [Listener at localhost/42921] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6678d305 to 127.0.0.1:62210 2023-02-12 12:03:21,728 DEBUG [Listener at localhost/42921] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:21,728 INFO [Listener at localhost/42921] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38959,1676203395348' ***** 2023-02-12 12:03:21,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:21,728 INFO [Listener at localhost/42921] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:21,729 INFO [Listener at localhost/42921] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45149,1676203395383' ***** 2023-02-12 12:03:21,729 INFO [Listener at localhost/42921] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:21,729 INFO [RS:0;jenkins-hbase4:38959] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:21,729 INFO [RS:0;jenkins-hbase4:38959] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:21,729 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:21,729 INFO [RS:0;jenkins-hbase4:38959] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:21,730 INFO [RS:1;jenkins-hbase4:45149] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:21,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:21,730 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:21,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:21,730 INFO [RS:1;jenkins-hbase4:45149] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:21,730 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(3304): Received CLOSE for 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:21,731 INFO [RS:1;jenkins-hbase4:45149] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:21,731 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(3304): Received CLOSE for 73ac448467573948a815516a288a05fc 2023-02-12 12:03:21,731 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(3304): Received CLOSE for b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:21,732 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(3304): Received CLOSE for d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:21,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 349509f1216b0a92a12cfc3d7115404a, disabling compactions & flushes 2023-02-12 12:03:21,732 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(3304): Received CLOSE for fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:21,732 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(3304): Received CLOSE for ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:21,732 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(3304): Received CLOSE for 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:21,732 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(3304): Received CLOSE for dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:21,732 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:21,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:21,732 DEBUG [RS:0;jenkins-hbase4:38959] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33f40dba to 127.0.0.1:62210 2023-02-12 12:03:21,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:21,732 DEBUG [RS:0;jenkins-hbase4:38959] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:21,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. after waiting 0 ms 2023-02-12 12:03:21,732 INFO [RS:0;jenkins-hbase4:38959] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:21,732 INFO [RS:0;jenkins-hbase4:38959] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:21,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:21,732 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(3304): Received CLOSE for 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:21,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b74578a527e8a472b5e0eb8682764b58, disabling compactions & flushes 2023-02-12 12:03:21,732 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(3304): Received CLOSE for 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:21,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:21,732 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(3304): Received CLOSE for 811f0e91a43bae27553f1c50fcfe0cc9 2023-02-12 12:03:21,732 INFO [RS:0;jenkins-hbase4:38959] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:21,732 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,732 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 12:03:21,733 DEBUG [RS:1;jenkins-hbase4:45149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5176be45 to 127.0.0.1:62210 2023-02-12 12:03:21,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:21,733 DEBUG [RS:1;jenkins-hbase4:45149] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:21,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. after waiting 0 ms 2023-02-12 12:03:21,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:21,733 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-12 12:03:21,733 DEBUG [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1479): Online Regions={b74578a527e8a472b5e0eb8682764b58=testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58., ae9f25198523ff4989772be17b20b711=testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711., dd7eac03420b5d08ba5e8ed75de2df7e=testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e., 2d075e1d85beb58c0572d12964b34a20=testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20., 7c935bb96b6eefe3d9f88a5f3c0c47f3=testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3., 811f0e91a43bae27553f1c50fcfe0cc9=hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9.} 2023-02-12 12:03:21,733 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-12 12:03:21,733 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1479): Online Regions={349509f1216b0a92a12cfc3d7115404a=testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a., 73ac448467573948a815516a288a05fc=testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc., d06b98edd97b470ebe5c7bd4dc373b7f=testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f., 1588230740=hbase:meta,,1.1588230740, fb0dff0e70a5d13ebabc7d0c10b510bd=testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd., 9fdbdad26d3d788587798ebf73be17d4=testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.} 2023-02-12 12:03:21,733 DEBUG [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1505): Waiting on 2d075e1d85beb58c0572d12964b34a20, 7c935bb96b6eefe3d9f88a5f3c0c47f3, 811f0e91a43bae27553f1c50fcfe0cc9, ae9f25198523ff4989772be17b20b711, b74578a527e8a472b5e0eb8682764b58, dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:21,733 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1505): Waiting on 1588230740, 349509f1216b0a92a12cfc3d7115404a, 73ac448467573948a815516a288a05fc, 9fdbdad26d3d788587798ebf73be17d4, d06b98edd97b470ebe5c7bd4dc373b7f, fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:21,733 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:21,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:21,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:21,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:21,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:21,736 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-12 12:03:21,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 12:03:21,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:21,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 349509f1216b0a92a12cfc3d7115404a: Waiting for close lock at 1676203401732Running coprocessor pre-close hooks at 1676203401732Disabling compacts and flushes for region at 1676203401732Disabling writes for close at 1676203401732Writing region close event to WAL at 1676203401732Running coprocessor post-close hooks at 1676203401742 (+10 ms)Closed at 1676203401742 2023-02-12 12:03:21,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:21,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 73ac448467573948a815516a288a05fc, disabling compactions & flushes 2023-02-12 12:03:21,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:21,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:21,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:21,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. after waiting 0 ms 2023-02-12 12:03:21,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:21,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:21,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b74578a527e8a472b5e0eb8682764b58: Waiting for close lock at 1676203401732Running coprocessor pre-close hooks at 1676203401732Disabling compacts and flushes for region at 1676203401732Disabling writes for close at 1676203401733 (+1 ms)Writing region close event to WAL at 1676203401739 (+6 ms)Running coprocessor post-close hooks at 1676203401744 (+5 ms)Closed at 1676203401745 (+1 ms) 2023-02-12 12:03:21,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:21,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ae9f25198523ff4989772be17b20b711, disabling compactions & flushes 2023-02-12 12:03:21,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:21,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:21,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. after waiting 0 ms 2023-02-12 12:03:21,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:21,753 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:21,753 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:21,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:21,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:21,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 73ac448467573948a815516a288a05fc: Waiting for close lock at 1676203401742Running coprocessor pre-close hooks at 1676203401742Disabling compacts and flushes for region at 1676203401742Disabling writes for close at 1676203401743 (+1 ms)Writing region close event to WAL at 1676203401753 (+10 ms)Running coprocessor post-close hooks at 1676203401761 (+8 ms)Closed at 1676203401761 2023-02-12 12:03:21,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:21,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:21,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d06b98edd97b470ebe5c7bd4dc373b7f, disabling compactions & flushes 2023-02-12 12:03:21,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:21,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:21,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. after waiting 0 ms 2023-02-12 12:03:21,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:21,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:21,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ae9f25198523ff4989772be17b20b711: Waiting for close lock at 1676203401746Running coprocessor pre-close hooks at 1676203401746Disabling compacts and flushes for region at 1676203401746Disabling writes for close at 1676203401746Writing region close event to WAL at 1676203401757 (+11 ms)Running coprocessor post-close hooks at 1676203401762 (+5 ms)Closed at 1676203401762 2023-02-12 12:03:21,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:21,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dd7eac03420b5d08ba5e8ed75de2df7e, disabling compactions & flushes 2023-02-12 12:03:21,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:21,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:21,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. after waiting 0 ms 2023-02-12 12:03:21,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:21,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:21,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:21,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d06b98edd97b470ebe5c7bd4dc373b7f: Waiting for close lock at 1676203401761Running coprocessor pre-close hooks at 1676203401761Disabling compacts and flushes for region at 1676203401761Disabling writes for close at 1676203401761Writing region close event to WAL at 1676203401772 (+11 ms)Running coprocessor post-close hooks at 1676203401775 (+3 ms)Closed at 1676203401775 2023-02-12 12:03:21,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:21,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:21,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fb0dff0e70a5d13ebabc7d0c10b510bd, disabling compactions & flushes 2023-02-12 12:03:21,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:21,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:21,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. after waiting 0 ms 2023-02-12 12:03:21,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:21,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:21,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dd7eac03420b5d08ba5e8ed75de2df7e: Waiting for close lock at 1676203401764Running coprocessor pre-close hooks at 1676203401764Disabling compacts and flushes for region at 1676203401764Disabling writes for close at 1676203401765 (+1 ms)Writing region close event to WAL at 1676203401772 (+7 ms)Running coprocessor post-close hooks at 1676203401776 (+4 ms)Closed at 1676203401776 2023-02-12 12:03:21,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:21,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2d075e1d85beb58c0572d12964b34a20, disabling compactions & flushes 2023-02-12 12:03:21,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:21,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:21,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. after waiting 0 ms 2023-02-12 12:03:21,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:21,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 12:03:21,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fb0dff0e70a5d13ebabc7d0c10b510bd: Waiting for close lock at 1676203401775Running coprocessor pre-close hooks at 1676203401775Disabling compacts and flushes for region at 1676203401775Disabling writes for close at 1676203401776 (+1 ms)Writing region close event to WAL at 1676203401778 (+2 ms)Running coprocessor post-close hooks at 1676203401781 (+3 ms)Closed at 1676203401781 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:21,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9fdbdad26d3d788587798ebf73be17d4, disabling compactions & flushes 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2d075e1d85beb58c0572d12964b34a20: Waiting for close lock at 1676203401776Running coprocessor pre-close hooks at 1676203401776Disabling compacts and flushes for region at 1676203401776Disabling writes for close at 1676203401776Writing region close event to WAL at 1676203401778 (+2 ms)Running coprocessor post-close hooks at 1676203401781 (+3 ms)Closed at 1676203401781 2023-02-12 12:03:21,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. after waiting 0 ms 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7c935bb96b6eefe3d9f88a5f3c0c47f3, disabling compactions & flushes 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:21,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. after waiting 0 ms 2023-02-12 12:03:21,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:21,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:21,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:21,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:21,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9fdbdad26d3d788587798ebf73be17d4: Waiting for close lock at 1676203401781Running coprocessor pre-close hooks at 1676203401781Disabling compacts and flushes for region at 1676203401781Disabling writes for close at 1676203401781Writing region close event to WAL at 1676203401782 (+1 ms)Running coprocessor post-close hooks at 1676203401785 (+3 ms)Closed at 1676203401785 2023-02-12 12:03:21,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:21,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:21,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7c935bb96b6eefe3d9f88a5f3c0c47f3: Waiting for close lock at 1676203401781Running coprocessor pre-close hooks at 1676203401781Disabling compacts and flushes for region at 1676203401781Disabling writes for close at 1676203401781Writing region close event to WAL at 1676203401783 (+2 ms)Running coprocessor post-close hooks at 1676203401786 (+3 ms)Closed at 1676203401786 2023-02-12 12:03:21,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:21,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 811f0e91a43bae27553f1c50fcfe0cc9, disabling compactions & flushes 2023-02-12 12:03:21,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:21,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:21,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. after waiting 0 ms 2023-02-12 12:03:21,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:21,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 811f0e91a43bae27553f1c50fcfe0cc9 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 12:03:21,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9/.tmp/info/56bf2c9d652e4997b70238397270d63a 2023-02-12 12:03:21,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9/.tmp/info/56bf2c9d652e4997b70238397270d63a as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9/info/56bf2c9d652e4997b70238397270d63a 2023-02-12 12:03:21,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9/info/56bf2c9d652e4997b70238397270d63a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 12:03:21,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 811f0e91a43bae27553f1c50fcfe0cc9 in 18ms, sequenceid=6, compaction requested=false 2023-02-12 12:03:21,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/namespace/811f0e91a43bae27553f1c50fcfe0cc9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 12:03:21,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:21,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 811f0e91a43bae27553f1c50fcfe0cc9: Waiting for close lock at 1676203401786Running coprocessor pre-close hooks at 1676203401786Disabling compacts and flushes for region at 1676203401786Disabling writes for close at 1676203401786Obtaining lock to block concurrent updates at 1676203401786Preparing flush snapshotting stores in 811f0e91a43bae27553f1c50fcfe0cc9 at 1676203401786Finished memstore snapshotting hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676203401786Flushing stores of hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. at 1676203401787 (+1 ms)Flushing 811f0e91a43bae27553f1c50fcfe0cc9/info: creating writer at 1676203401787Flushing 811f0e91a43bae27553f1c50fcfe0cc9/info: appending metadata at 1676203401788 (+1 ms)Flushing 811f0e91a43bae27553f1c50fcfe0cc9/info: closing flushed file at 1676203401788Flushing 811f0e91a43bae27553f1c50fcfe0cc9/info: reopening flushed file at 1676203401798 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 811f0e91a43bae27553f1c50fcfe0cc9 in 18ms, sequenceid=6, compaction requested=false at 1676203401804 (+6 ms)Writing region close event to WAL at 1676203401805 (+1 ms)Running coprocessor post-close hooks at 1676203401808 (+3 ms)Closed at 1676203401808 2023-02-12 12:03:21,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676203396189.811f0e91a43bae27553f1c50fcfe0cc9. 2023-02-12 12:03:21,933 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45149,1676203395383; all regions closed. 2023-02-12 12:03:21,933 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:21,938 DEBUG [RS:1;jenkins-hbase4:45149] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/oldWALs 2023-02-12 12:03:21,938 INFO [RS:1;jenkins-hbase4:45149] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45149%2C1676203395383:(num 1676203396710) 2023-02-12 12:03:21,938 DEBUG [RS:1;jenkins-hbase4:45149] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:21,938 INFO [RS:1;jenkins-hbase4:45149] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:21,939 INFO [RS:1;jenkins-hbase4:45149] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:21,939 INFO [RS:1;jenkins-hbase4:45149] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:21,939 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:21,939 INFO [RS:1;jenkins-hbase4:45149] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:21,939 INFO [RS:1;jenkins-hbase4:45149] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:21,940 INFO [RS:1;jenkins-hbase4:45149] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45149 2023-02-12 12:03:21,942 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,942 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:21,942 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:21,942 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45149,1676203395383 2023-02-12 12:03:21,943 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:21,943 ERROR [Listener at localhost/42921-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17b8901b rejected from java.util.concurrent.ThreadPoolExecutor@13870634[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:21,943 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45149,1676203395383] 2023-02-12 12:03:21,943 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45149,1676203395383; numProcessing=1 2023-02-12 12:03:21,945 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45149,1676203395383 already deleted, retry=false 2023-02-12 12:03:21,946 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45149,1676203395383 expired; onlineServers=1 2023-02-12 12:03:22,134 DEBUG [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:22,162 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/.tmp/info/987e10bb98e9460089dc446bb38983a6 2023-02-12 12:03:22,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/.tmp/table/c88186e578be436d8c8d59e6662cf295 2023-02-12 12:03:22,179 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/.tmp/info/987e10bb98e9460089dc446bb38983a6 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/info/987e10bb98e9460089dc446bb38983a6 2023-02-12 12:03:22,184 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/info/987e10bb98e9460089dc446bb38983a6, entries=110, sequenceid=32, filesize=18.7 K 2023-02-12 12:03:22,185 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/.tmp/table/c88186e578be436d8c8d59e6662cf295 as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/table/c88186e578be436d8c8d59e6662cf295 2023-02-12 12:03:22,189 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/table/c88186e578be436d8c8d59e6662cf295, entries=4, sequenceid=32, filesize=4.8 K 2023-02-12 12:03:22,190 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 455ms, sequenceid=32, compaction requested=false 2023-02-12 12:03:22,196 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-12 12:03:22,197 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:22,198 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:22,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203401733Running coprocessor pre-close hooks at 1676203401733Disabling compacts and flushes for region at 1676203401733Disabling writes for close at 1676203401735 (+2 ms)Obtaining lock to block concurrent updates at 1676203401736 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676203401736Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676203401737 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676203401739 (+2 ms)Flushing 1588230740/info: creating writer at 1676203401739Flushing 1588230740/info: appending metadata at 1676203401742 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676203401742Flushing 1588230740/table: creating writer at 1676203402167 (+425 ms)Flushing 1588230740/table: appending metadata at 1676203402169 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676203402169Flushing 1588230740/info: reopening flushed file at 1676203402180 (+11 ms)Flushing 1588230740/table: reopening flushed file at 1676203402185 (+5 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 455ms, sequenceid=32, compaction requested=false at 1676203402190 (+5 ms)Writing region close event to WAL at 1676203402194 (+4 ms)Running coprocessor post-close hooks at 1676203402197 (+3 ms)Closed at 1676203402198 (+1 ms) 2023-02-12 12:03:22,198 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:22,229 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:22,229 INFO [RS:1;jenkins-hbase4:45149] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45149,1676203395383; zookeeper connection closed. 2023-02-12 12:03:22,229 ERROR [Listener at localhost/42921-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3472d8f9 rejected from java.util.concurrent.ThreadPoolExecutor@13870634[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:22,230 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x1004869f2750002, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:22,230 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3c920bb7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3c920bb7 2023-02-12 12:03:22,230 ERROR [Listener at localhost/42921-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c04b255 rejected from java.util.concurrent.ThreadPoolExecutor@13870634[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:22,334 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38959,1676203395348; all regions closed. 2023-02-12 12:03:22,339 DEBUG [RS:0;jenkins-hbase4:38959] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/oldWALs 2023-02-12 12:03:22,339 INFO [RS:0;jenkins-hbase4:38959] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38959%2C1676203395348.meta:.meta(num 1676203395978) 2023-02-12 12:03:22,343 DEBUG [RS:0;jenkins-hbase4:38959] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/oldWALs 2023-02-12 12:03:22,343 INFO [RS:0;jenkins-hbase4:38959] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38959%2C1676203395348:(num 1676203396714) 2023-02-12 12:03:22,344 DEBUG [RS:0;jenkins-hbase4:38959] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:22,344 INFO [RS:0;jenkins-hbase4:38959] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:22,344 INFO [RS:0;jenkins-hbase4:38959] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:22,344 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:22,345 INFO [RS:0;jenkins-hbase4:38959] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38959 2023-02-12 12:03:22,347 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38959,1676203395348 2023-02-12 12:03:22,347 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:22,347 ERROR [Listener at localhost/42921-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d625776 rejected from java.util.concurrent.ThreadPoolExecutor@195dc002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:22,348 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38959,1676203395348] 2023-02-12 12:03:22,348 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38959,1676203395348; numProcessing=2 2023-02-12 12:03:22,350 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38959,1676203395348 already deleted, retry=false 2023-02-12 12:03:22,350 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38959,1676203395348 expired; onlineServers=0 2023-02-12 12:03:22,350 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44927,1676203395274' ***** 2023-02-12 12:03:22,350 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 12:03:22,351 DEBUG [M:0;jenkins-hbase4:44927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ec0e1ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:22,351 INFO [M:0;jenkins-hbase4:44927] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44927,1676203395274 2023-02-12 12:03:22,351 INFO [M:0;jenkins-hbase4:44927] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44927,1676203395274; all regions closed. 2023-02-12 12:03:22,351 DEBUG [M:0;jenkins-hbase4:44927] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:22,351 DEBUG [M:0;jenkins-hbase4:44927] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 12:03:22,351 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 12:03:22,351 DEBUG [M:0;jenkins-hbase4:44927] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 12:03:22,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203395584] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203395584,5,FailOnTimeoutGroup] 2023-02-12 12:03:22,352 INFO [M:0;jenkins-hbase4:44927] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 12:03:22,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203395583] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203395583,5,FailOnTimeoutGroup] 2023-02-12 12:03:22,352 INFO [M:0;jenkins-hbase4:44927] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 12:03:22,353 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:22,353 INFO [M:0;jenkins-hbase4:44927] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 12:03:22,353 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:22,353 DEBUG [M:0;jenkins-hbase4:44927] master.HMaster(1502): Stopping service threads 2023-02-12 12:03:22,353 INFO [M:0;jenkins-hbase4:44927] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 12:03:22,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:22,353 ERROR [M:0;jenkins-hbase4:44927] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 12:03:22,354 INFO [M:0;jenkins-hbase4:44927] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 12:03:22,354 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 12:03:22,354 DEBUG [M:0;jenkins-hbase4:44927] zookeeper.ZKUtil(398): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 12:03:22,354 WARN [M:0;jenkins-hbase4:44927] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 12:03:22,354 INFO [M:0;jenkins-hbase4:44927] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 12:03:22,354 INFO [M:0;jenkins-hbase4:44927] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 12:03:22,355 DEBUG [M:0;jenkins-hbase4:44927] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:22,355 INFO [M:0;jenkins-hbase4:44927] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:22,355 DEBUG [M:0;jenkins-hbase4:44927] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:22,355 DEBUG [M:0;jenkins-hbase4:44927] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:22,355 DEBUG [M:0;jenkins-hbase4:44927] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:22,355 INFO [M:0;jenkins-hbase4:44927] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-12 12:03:22,363 INFO [M:0;jenkins-hbase4:44927] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5a705582ebe49f8857ac7f702000d9e 2023-02-12 12:03:22,368 DEBUG [M:0;jenkins-hbase4:44927] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5a705582ebe49f8857ac7f702000d9e as hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5a705582ebe49f8857ac7f702000d9e 2023-02-12 12:03:22,373 INFO [M:0;jenkins-hbase4:44927] regionserver.HStore(1080): Added hdfs://localhost:38661/user/jenkins/test-data/8663a9f7-3188-eda1-e7a7-a132db501e20/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5a705582ebe49f8857ac7f702000d9e, entries=31, sequenceid=218, filesize=9.0 K 2023-02-12 12:03:22,374 INFO [M:0;jenkins-hbase4:44927] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false 2023-02-12 12:03:22,374 INFO [M:0;jenkins-hbase4:44927] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:22,375 DEBUG [M:0;jenkins-hbase4:44927] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203402355Disabling compacts and flushes for region at 1676203402355Disabling writes for close at 1676203402355Obtaining lock to block concurrent updates at 1676203402355Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676203402355Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676203402355Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676203402356 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676203402356Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676203402358 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676203402358Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676203402369 (+11 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false at 1676203402374 (+5 ms)Writing region close event to WAL at 1676203402374Closed at 1676203402374 2023-02-12 12:03:22,378 INFO [M:0;jenkins-hbase4:44927] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 12:03:22,378 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:22,379 INFO [M:0;jenkins-hbase4:44927] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44927 2023-02-12 12:03:22,383 DEBUG [M:0;jenkins-hbase4:44927] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44927,1676203395274 already deleted, retry=false 2023-02-12 12:03:22,449 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:22,449 INFO [RS:0;jenkins-hbase4:38959] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38959,1676203395348; zookeeper connection closed. 2023-02-12 12:03:22,449 ERROR [Listener at localhost/42921-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@629f838f rejected from java.util.concurrent.ThreadPoolExecutor@195dc002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:22,449 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@686bec8d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@686bec8d 2023-02-12 12:03:22,449 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): regionserver:38959-0x1004869f2750001, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:22,449 ERROR [Listener at localhost/42921-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ae32126 rejected from java.util.concurrent.ThreadPoolExecutor@195dc002[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:22,449 INFO [Listener at localhost/42921] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 12:03:22,549 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:22,549 INFO [M:0;jenkins-hbase4:44927] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44927,1676203395274; zookeeper connection closed. 2023-02-12 12:03:22,549 ERROR [Listener at localhost/42921-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b7042ce rejected from java.util.concurrent.ThreadPoolExecutor@6f4fcb78[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:22,550 DEBUG [Listener at localhost/42921-EventThread] zookeeper.ZKWatcher(600): master:44927-0x1004869f2750000, quorum=127.0.0.1:62210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:22,550 ERROR [Listener at localhost/42921-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72a21a54 rejected from java.util.concurrent.ThreadPoolExecutor@6f4fcb78[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:22,636 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/hadoop-5896073377995972830.jar 2023-02-12 12:03:22,640 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676203399012 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:22,640 DEBUG [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: 73ac448467573948a815516a288a05fc 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:22,641 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(239): region to add: 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=b74578a527e8a472b5e0eb8682764b58 as b74578a527e8a472b5e0eb8682764b58 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=ae9f25198523ff4989772be17b20b711 as ae9f25198523ff4989772be17b20b711 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=349509f1216b0a92a12cfc3d7115404a as 349509f1216b0a92a12cfc3d7115404a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=73ac448467573948a815516a288a05fc as 73ac448467573948a815516a288a05fc in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=d06b98edd97b470ebe5c7bd4dc373b7f as d06b98edd97b470ebe5c7bd4dc373b7f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=fb0dff0e70a5d13ebabc7d0c10b510bd as fb0dff0e70a5d13ebabc7d0c10b510bd in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=dd7eac03420b5d08ba5e8ed75de2df7e as dd7eac03420b5d08ba5e8ed75de2df7e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=2d075e1d85beb58c0572d12964b34a20 as 2d075e1d85beb58c0572d12964b34a20 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=9fdbdad26d3d788587798ebf73be17d4 as 9fdbdad26d3d788587798ebf73be17d4 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,642 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(585): clone region=7c935bb96b6eefe3d9f88a5f3c0c47f3 as 7c935bb96b6eefe3d9f88a5f3c0c47f3 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 12:03:22,643 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 349509f1216b0a92a12cfc3d7115404a, NAME => 'testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,644 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d06b98edd97b470ebe5c7bd4dc373b7f, NAME => 'testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,644 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 73ac448467573948a815516a288a05fc, NAME => 'testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,644 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => ae9f25198523ff4989772be17b20b711, NAME => 'testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,644 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b74578a527e8a472b5e0eb8682764b58, NAME => 'testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,645 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => fb0dff0e70a5d13ebabc7d0c10b510bd, NAME => 'testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,645 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => dd7eac03420b5d08ba5e8ed75de2df7e, NAME => 'testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,646 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2d075e1d85beb58c0572d12964b34a20, NAME => 'testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,656 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,656 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 349509f1216b0a92a12cfc3d7115404a, disabling compactions & flushes 2023-02-12 12:03:22,656 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:22,656 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:22,656 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. after waiting 0 ms 2023-02-12 12:03:22,656 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:22,656 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:22,656 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 349509f1216b0a92a12cfc3d7115404a: Waiting for close lock at 1676203402656Disabling compacts and flushes for region at 1676203402656Disabling writes for close at 1676203402656Writing region close event to WAL at 1676203402656Closed at 1676203402656 2023-02-12 12:03:22,657 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9fdbdad26d3d788587798ebf73be17d4, NAME => 'testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,676 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,677 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,677 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f05ad870a7b24d65a75e1c6fcd2dda48 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,677 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c7908d60a3db463f96af4329c9060a58 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,678 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,678 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 853d53dbc17f4ad7bb4baf311f9e2cc2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,678 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,679 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 204a296b97c447cbba598c7baaa5317b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,681 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,681 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 82d9f99f0fe14f149dbee92c058a51bc from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,681 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,681 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 217931233a5448eba149b57365b95f6b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,681 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,682 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2d075e1d85beb58c0572d12964b34a20, disabling compactions & flushes 2023-02-12 12:03:22,682 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:22,682 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1636dda6d3b6408ab7e7f6a7af65391c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,682 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:22,682 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. after waiting 0 ms 2023-02-12 12:03:22,682 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:22,682 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:22,682 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2d075e1d85beb58c0572d12964b34a20: Waiting for close lock at 1676203402682Disabling compacts and flushes for region at 1676203402682Disabling writes for close at 1676203402682Writing region close event to WAL at 1676203402682Closed at 1676203402682 2023-02-12 12:03:22,682 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 7c935bb96b6eefe3d9f88a5f3c0c47f3, NAME => 'testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,685 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 648c72733aba4d84ab19af57edef89a3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,686 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 337244d18a9a4ff790bef0474d9b6a43 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,686 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,686 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 38cb989e413748828b57abb849a0f35c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,687 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 81cf0b483e9b4143be60f0b1481f582b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,688 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing fb0dff0e70a5d13ebabc7d0c10b510bd, disabling compactions & flushes 2023-02-12 12:03:22,688 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:22,688 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:22,688 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. after waiting 0 ms 2023-02-12 12:03:22,688 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:22,688 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:22,688 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for fb0dff0e70a5d13ebabc7d0c10b510bd: Waiting for close lock at 1676203402688Disabling compacts and flushes for region at 1676203402688Disabling writes for close at 1676203402688Writing region close event to WAL at 1676203402688Closed at 1676203402688 2023-02-12 12:03:22,688 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bc39f33fe37d417a869101ec85766890 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,689 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b7121d83a63c4a7e9986aed442858831 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b74578a527e8a472b5e0eb8682764b58, disabling compactions & flushes 2023-02-12 12:03:22,690 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:22,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:22,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. after waiting 0 ms 2023-02-12 12:03:22,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:22,690 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:22,690 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b74578a527e8a472b5e0eb8682764b58: Waiting for close lock at 1676203402690Disabling compacts and flushes for region at 1676203402690Disabling writes for close at 1676203402690Writing region close event to WAL at 1676203402690Closed at 1676203402690 2023-02-12 12:03:22,692 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing dd7eac03420b5d08ba5e8ed75de2df7e, disabling compactions & flushes 2023-02-12 12:03:22,692 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:22,692 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:22,692 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. after waiting 0 ms 2023-02-12 12:03:22,692 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:22,692 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:22,692 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for dd7eac03420b5d08ba5e8ed75de2df7e: Waiting for close lock at 1676203402692Disabling compacts and flushes for region at 1676203402692Disabling writes for close at 1676203402692Writing region close event to WAL at 1676203402692Closed at 1676203402692 2023-02-12 12:03:22,692 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing ae9f25198523ff4989772be17b20b711, disabling compactions & flushes 2023-02-12 12:03:22,692 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 39a939bd96a5498d95c077c3dea73e7f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,692 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:22,692 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:22,693 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. after waiting 0 ms 2023-02-12 12:03:22,693 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:22,693 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:22,693 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for ae9f25198523ff4989772be17b20b711: Waiting for close lock at 1676203402692Disabling compacts and flushes for region at 1676203402692Disabling writes for close at 1676203402693 (+1 ms)Writing region close event to WAL at 1676203402693Closed at 1676203402693 2023-02-12 12:03:22,696 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 9fdbdad26d3d788587798ebf73be17d4, disabling compactions & flushes 2023-02-12 12:03:22,696 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d06b98edd97b470ebe5c7bd4dc373b7f, disabling compactions & flushes 2023-02-12 12:03:22,697 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:22,696 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 73ac448467573948a815516a288a05fc, disabling compactions & flushes 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:22,697 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. after waiting 0 ms 2023-02-12 12:03:22,697 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:22,697 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 9fdbdad26d3d788587798ebf73be17d4: Waiting for close lock at 1676203402696Disabling compacts and flushes for region at 1676203402696Disabling writes for close at 1676203402697 (+1 ms)Writing region close event to WAL at 1676203402697Closed at 1676203402697 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. after waiting 0 ms 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. after waiting 0 ms 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:22,697 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:22,697 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:22,697 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 73ac448467573948a815516a288a05fc: Waiting for close lock at 1676203402696Disabling compacts and flushes for region at 1676203402696Disabling writes for close at 1676203402697 (+1 ms)Writing region close event to WAL at 1676203402697Closed at 1676203402697 2023-02-12 12:03:22,698 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d06b98edd97b470ebe5c7bd4dc373b7f: Waiting for close lock at 1676203402696Disabling compacts and flushes for region at 1676203402696Disabling writes for close at 1676203402697 (+1 ms)Writing region close event to WAL at 1676203402697Closed at 1676203402697 2023-02-12 12:03:22,698 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:22,698 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b4cec6a640b440189a04cc23da7d4ca2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,700 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink af4003b1f0ca406cad430ec6c317971e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 12:03:22,702 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 7c935bb96b6eefe3d9f88a5f3c0c47f3, disabling compactions & flushes 2023-02-12 12:03:22,702 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:22,702 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:22,702 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. after waiting 0 ms 2023-02-12 12:03:22,702 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:22,703 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:22,703 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 7c935bb96b6eefe3d9f88a5f3c0c47f3: Waiting for close lock at 1676203402702Disabling compacts and flushes for region at 1676203402702Disabling writes for close at 1676203402702Writing region close event to WAL at 1676203402703 (+1 ms)Closed at 1676203402703 2023-02-12 12:03:22,703 INFO [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676203399012 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:22,703 DEBUG [Listener at localhost/42921] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,703 DEBUG [Listener at localhost/42921] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c 2023-02-12 12:03:22,704 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-data/ 2023-02-12 12:03:22,704 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----default/ 2023-02-12 12:03:22,705 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 12:03:22,705 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------2d075e1d85beb58c0572d12964b34a20/ 2023-02-12 12:03:22,706 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,706 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------349509f1216b0a92a12cfc3d7115404a/ 2023-02-12 12:03:22,706 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,706 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------73ac448467573948a815516a288a05fc/ 2023-02-12 12:03:22,707 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,707 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:22,707 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=73ac448467573948a815516a288a05fc-217931233a5448eba149b57365b95f6b 2023-02-12 12:03:22,707 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:22,707 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=73ac448467573948a815516a288a05fc-b7121d83a63c4a7e9986aed442858831 2023-02-12 12:03:22,707 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------7c935bb96b6eefe3d9f88a5f3c0c47f3/ 2023-02-12 12:03:22,708 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,708 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:22,708 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=7c935bb96b6eefe3d9f88a5f3c0c47f3-b4cec6a640b440189a04cc23da7d4ca2 2023-02-12 12:03:22,708 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:22,709 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=7c935bb96b6eefe3d9f88a5f3c0c47f3-af4003b1f0ca406cad430ec6c317971e 2023-02-12 12:03:22,709 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------9fdbdad26d3d788587798ebf73be17d4/ 2023-02-12 12:03:22,709 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,709 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:22,710 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=9fdbdad26d3d788587798ebf73be17d4-38cb989e413748828b57abb849a0f35c 2023-02-12 12:03:22,710 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:22,711 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=9fdbdad26d3d788587798ebf73be17d4-39a939bd96a5498d95c077c3dea73e7f 2023-02-12 12:03:22,711 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------ae9f25198523ff4989772be17b20b711/ 2023-02-12 12:03:22,711 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,711 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:22,712 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=ae9f25198523ff4989772be17b20b711-82d9f99f0fe14f149dbee92c058a51bc 2023-02-12 12:03:22,712 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:22,712 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=ae9f25198523ff4989772be17b20b711-337244d18a9a4ff790bef0474d9b6a43 2023-02-12 12:03:22,712 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------b74578a527e8a472b5e0eb8682764b58/ 2023-02-12 12:03:22,713 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,713 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:22,714 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=b74578a527e8a472b5e0eb8682764b58-853d53dbc17f4ad7bb4baf311f9e2cc2 2023-02-12 12:03:22,714 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:22,715 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=b74578a527e8a472b5e0eb8682764b58-648c72733aba4d84ab19af57edef89a3 2023-02-12 12:03:22,715 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------d06b98edd97b470ebe5c7bd4dc373b7f/ 2023-02-12 12:03:22,715 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,715 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:22,716 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=d06b98edd97b470ebe5c7bd4dc373b7f-204a296b97c447cbba598c7baaa5317b 2023-02-12 12:03:22,716 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:22,717 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=d06b98edd97b470ebe5c7bd4dc373b7f-bc39f33fe37d417a869101ec85766890 2023-02-12 12:03:22,717 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------dd7eac03420b5d08ba5e8ed75de2df7e/ 2023-02-12 12:03:22,717 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,717 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:22,718 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=dd7eac03420b5d08ba5e8ed75de2df7e-f05ad870a7b24d65a75e1c6fcd2dda48 2023-02-12 12:03:22,718 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:22,718 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=dd7eac03420b5d08ba5e8ed75de2df7e-81cf0b483e9b4143be60f0b1481f582b 2023-02-12 12:03:22,718 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |----------fb0dff0e70a5d13ebabc7d0c10b510bd/ 2023-02-12 12:03:22,719 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:22,719 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:22,719 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=fb0dff0e70a5d13ebabc7d0c10b510bd-c7908d60a3db463f96af4329c9060a58 2023-02-12 12:03:22,719 DEBUG [Listener at localhost/42921] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:22,720 DEBUG [Listener at localhost/42921] util.CommonFSUtils(702): |----------------testWithMapReduce=fb0dff0e70a5d13ebabc7d0c10b510bd-1636dda6d3b6408ab7e7f6a7af65391c 2023-02-12 12:03:22,720 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,721 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,721 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,721 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,722 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,722 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,722 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,788 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/hadoop-4619074995780040152.jar 2023-02-12 12:03:22,788 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,789 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,789 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,790 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,790 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,791 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,791 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 12:03:22,791 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 12:03:22,792 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 12:03:22,792 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 12:03:22,792 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 12:03:22,793 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 12:03:22,793 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 12:03:22,793 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 12:03:22,794 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 12:03:22,794 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 12:03:22,795 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:22,795 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 12:03:22,795 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 12:03:22,796 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 12:03:22,796 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 12:03:22,861 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/hadoop-96446606138462474.jar 2023-02-12 12:03:22,862 DEBUG [Listener at localhost/42921] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 12:03:22,867 WARN [Listener at localhost/42921] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 12:03:22,897 INFO [Listener at localhost/42921] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 12:03:23,016 WARN [Listener at localhost/42921] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/mapreduce.cluster.local.dir/1676203402981/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 12:03:23,017 WARN [Listener at localhost/42921] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/mapreduce.cluster.local.dir/1676203402981/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 12:03:23,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,071 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,073 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,075 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:23,077 DEBUG [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20/f1 2023-02-12 12:03:23,077 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d075e1d85beb58c0572d12964b34a20 columnFamilyName f1 2023-02-12 12:03:23,078 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] regionserver.HStore(310): Store=2d075e1d85beb58c0572d12964b34a20/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,078 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2d075e1d85beb58c0572d12964b34a20 2023-02-12 12:03:23,080 DEBUG [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/2d075e1d85beb58c0572d12964b34a20/f2 2023-02-12 12:03:23,080 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d075e1d85beb58c0572d12964b34a20 columnFamilyName f2 2023-02-12 12:03:23,081 INFO [StoreOpener-2d075e1d85beb58c0572d12964b34a20-1] regionserver.HStore(310): Store=2d075e1d85beb58c0572d12964b34a20/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,081 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2d075e1d85beb58c0572d12964b34a20; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70914826, jitterRate=0.056713253259658813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,081 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2d075e1d85beb58c0572d12964b34a20: Writing region info on filesystem at 1676203403073Initializing all the Stores at 1676203403074 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403074Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403074Region opened successfully at 1676203403081 (+7 ms) 2023-02-12 12:03:23,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2d075e1d85beb58c0572d12964b34a20, disabling compactions & flushes 2023-02-12 12:03:23,100 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:23,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:23,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. after waiting 0 ms 2023-02-12 12:03:23,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:23,100 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676203397684.2d075e1d85beb58c0572d12964b34a20. 2023-02-12 12:03:23,101 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2d075e1d85beb58c0572d12964b34a20: Waiting for close lock at 1676203403100Disabling compacts and flushes for region at 1676203403100Disabling writes for close at 1676203403100Writing region close event to WAL at 1676203403100Closed at 1676203403100 2023-02-12 12:03:23,105 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,105 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,107 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,110 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 73ac448467573948a815516a288a05fc 2023-02-12 12:03:23,111 DEBUG [StoreOpener-73ac448467573948a815516a288a05fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1 2023-02-12 12:03:23,111 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73ac448467573948a815516a288a05fc columnFamilyName f1 2023-02-12 12:03:23,116 DEBUG [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f1/testWithMapReduce=73ac448467573948a815516a288a05fc-217931233a5448eba149b57365b95f6b 2023-02-12 12:03:23,116 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(310): Store=73ac448467573948a815516a288a05fc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,116 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 73ac448467573948a815516a288a05fc 2023-02-12 12:03:23,117 DEBUG [StoreOpener-73ac448467573948a815516a288a05fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2 2023-02-12 12:03:23,117 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73ac448467573948a815516a288a05fc columnFamilyName f2 2023-02-12 12:03:23,121 DEBUG [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/73ac448467573948a815516a288a05fc/f2/testWithMapReduce=73ac448467573948a815516a288a05fc-b7121d83a63c4a7e9986aed442858831 2023-02-12 12:03:23,121 INFO [StoreOpener-73ac448467573948a815516a288a05fc-1] regionserver.HStore(310): Store=73ac448467573948a815516a288a05fc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,122 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 73ac448467573948a815516a288a05fc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67515715, jitterRate=0.006062552332878113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 73ac448467573948a815516a288a05fc: Writing region info on filesystem at 1676203403107Initializing all the Stores at 1676203403108 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403108Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403109 (+1 ms)Region opened successfully at 1676203403122 (+13 ms) 2023-02-12 12:03:23,158 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 73ac448467573948a815516a288a05fc, disabling compactions & flushes 2023-02-12 12:03:23,158 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:23,159 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:23,159 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. after waiting 0 ms 2023-02-12 12:03:23,159 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:23,159 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676203397684.73ac448467573948a815516a288a05fc. 2023-02-12 12:03:23,160 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 73ac448467573948a815516a288a05fc: Waiting for close lock at 1676203403158Disabling compacts and flushes for region at 1676203403158Disabling writes for close at 1676203403159 (+1 ms)Writing region close event to WAL at 1676203403159Closed at 1676203403159 2023-02-12 12:03:23,164 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,164 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,165 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,167 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:23,168 DEBUG [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1 2023-02-12 12:03:23,168 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c935bb96b6eefe3d9f88a5f3c0c47f3 columnFamilyName f1 2023-02-12 12:03:23,173 DEBUG [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f1/testWithMapReduce=7c935bb96b6eefe3d9f88a5f3c0c47f3-b4cec6a640b440189a04cc23da7d4ca2 2023-02-12 12:03:23,173 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(310): Store=7c935bb96b6eefe3d9f88a5f3c0c47f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,173 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7c935bb96b6eefe3d9f88a5f3c0c47f3 2023-02-12 12:03:23,174 DEBUG [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2 2023-02-12 12:03:23,174 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c935bb96b6eefe3d9f88a5f3c0c47f3 columnFamilyName f2 2023-02-12 12:03:23,178 DEBUG [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/7c935bb96b6eefe3d9f88a5f3c0c47f3/f2/testWithMapReduce=7c935bb96b6eefe3d9f88a5f3c0c47f3-af4003b1f0ca406cad430ec6c317971e 2023-02-12 12:03:23,178 INFO [StoreOpener-7c935bb96b6eefe3d9f88a5f3c0c47f3-1] regionserver.HStore(310): Store=7c935bb96b6eefe3d9f88a5f3c0c47f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,179 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,179 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7c935bb96b6eefe3d9f88a5f3c0c47f3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69094812, jitterRate=0.029592931270599365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,179 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7c935bb96b6eefe3d9f88a5f3c0c47f3: Writing region info on filesystem at 1676203403165Initializing all the Stores at 1676203403166 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403166Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403166Region opened successfully at 1676203403179 (+13 ms) 2023-02-12 12:03:23,208 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7c935bb96b6eefe3d9f88a5f3c0c47f3, disabling compactions & flushes 2023-02-12 12:03:23,208 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:23,208 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:23,208 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. after waiting 0 ms 2023-02-12 12:03:23,208 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:23,209 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676203397684.7c935bb96b6eefe3d9f88a5f3c0c47f3. 2023-02-12 12:03:23,209 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7c935bb96b6eefe3d9f88a5f3c0c47f3: Waiting for close lock at 1676203403208Disabling compacts and flushes for region at 1676203403208Disabling writes for close at 1676203403208Writing region close event to WAL at 1676203403209 (+1 ms)Closed at 1676203403209 2023-02-12 12:03:23,215 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,215 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,223 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,224 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:23,226 DEBUG [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a/f1 2023-02-12 12:03:23,226 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 349509f1216b0a92a12cfc3d7115404a columnFamilyName f1 2023-02-12 12:03:23,227 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] regionserver.HStore(310): Store=349509f1216b0a92a12cfc3d7115404a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,227 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 349509f1216b0a92a12cfc3d7115404a 2023-02-12 12:03:23,228 DEBUG [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/349509f1216b0a92a12cfc3d7115404a/f2 2023-02-12 12:03:23,228 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 349509f1216b0a92a12cfc3d7115404a columnFamilyName f2 2023-02-12 12:03:23,229 INFO [StoreOpener-349509f1216b0a92a12cfc3d7115404a-1] regionserver.HStore(310): Store=349509f1216b0a92a12cfc3d7115404a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,229 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,229 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 349509f1216b0a92a12cfc3d7115404a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73518265, jitterRate=0.09550751745700836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,229 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 349509f1216b0a92a12cfc3d7115404a: Writing region info on filesystem at 1676203403223Initializing all the Stores at 1676203403223Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403224 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403224Region opened successfully at 1676203403229 (+5 ms) 2023-02-12 12:03:23,259 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 349509f1216b0a92a12cfc3d7115404a, disabling compactions & flushes 2023-02-12 12:03:23,259 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:23,259 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:23,259 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. after waiting 0 ms 2023-02-12 12:03:23,259 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:23,276 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203397684.349509f1216b0a92a12cfc3d7115404a. 2023-02-12 12:03:23,276 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 349509f1216b0a92a12cfc3d7115404a: Waiting for close lock at 1676203403259Disabling compacts and flushes for region at 1676203403259Disabling writes for close at 1676203403259Writing region close event to WAL at 1676203403276 (+17 ms)Closed at 1676203403276 2023-02-12 12:03:23,296 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,296 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,339 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,345 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:23,346 DEBUG [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1 2023-02-12 12:03:23,347 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb0dff0e70a5d13ebabc7d0c10b510bd columnFamilyName f1 2023-02-12 12:03:23,352 DEBUG [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f1/testWithMapReduce=fb0dff0e70a5d13ebabc7d0c10b510bd-c7908d60a3db463f96af4329c9060a58 2023-02-12 12:03:23,352 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(310): Store=fb0dff0e70a5d13ebabc7d0c10b510bd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,352 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fb0dff0e70a5d13ebabc7d0c10b510bd 2023-02-12 12:03:23,353 DEBUG [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2 2023-02-12 12:03:23,353 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb0dff0e70a5d13ebabc7d0c10b510bd columnFamilyName f2 2023-02-12 12:03:23,358 DEBUG [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/fb0dff0e70a5d13ebabc7d0c10b510bd/f2/testWithMapReduce=fb0dff0e70a5d13ebabc7d0c10b510bd-1636dda6d3b6408ab7e7f6a7af65391c 2023-02-12 12:03:23,358 INFO [StoreOpener-fb0dff0e70a5d13ebabc7d0c10b510bd-1] regionserver.HStore(310): Store=fb0dff0e70a5d13ebabc7d0c10b510bd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,358 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,358 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fb0dff0e70a5d13ebabc7d0c10b510bd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62769182, jitterRate=-0.06466630101203918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,358 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fb0dff0e70a5d13ebabc7d0c10b510bd: Writing region info on filesystem at 1676203403339Initializing all the Stores at 1676203403340 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403340Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403344 (+4 ms)Region opened successfully at 1676203403358 (+14 ms) 2023-02-12 12:03:23,386 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fb0dff0e70a5d13ebabc7d0c10b510bd, disabling compactions & flushes 2023-02-12 12:03:23,387 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:23,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:23,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. after waiting 0 ms 2023-02-12 12:03:23,387 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:23,388 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676203397684.fb0dff0e70a5d13ebabc7d0c10b510bd. 2023-02-12 12:03:23,388 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fb0dff0e70a5d13ebabc7d0c10b510bd: Waiting for close lock at 1676203403386Disabling compacts and flushes for region at 1676203403386Disabling writes for close at 1676203403387 (+1 ms)Writing region close event to WAL at 1676203403388 (+1 ms)Closed at 1676203403388 2023-02-12 12:03:23,391 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,391 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,394 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,396 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:23,397 DEBUG [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1 2023-02-12 12:03:23,397 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b74578a527e8a472b5e0eb8682764b58 columnFamilyName f1 2023-02-12 12:03:23,402 DEBUG [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f1/testWithMapReduce=b74578a527e8a472b5e0eb8682764b58-853d53dbc17f4ad7bb4baf311f9e2cc2 2023-02-12 12:03:23,402 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(310): Store=b74578a527e8a472b5e0eb8682764b58/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,402 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b74578a527e8a472b5e0eb8682764b58 2023-02-12 12:03:23,403 DEBUG [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2 2023-02-12 12:03:23,403 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b74578a527e8a472b5e0eb8682764b58 columnFamilyName f2 2023-02-12 12:03:23,410 DEBUG [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/b74578a527e8a472b5e0eb8682764b58/f2/testWithMapReduce=b74578a527e8a472b5e0eb8682764b58-648c72733aba4d84ab19af57edef89a3 2023-02-12 12:03:23,410 INFO [StoreOpener-b74578a527e8a472b5e0eb8682764b58-1] regionserver.HStore(310): Store=b74578a527e8a472b5e0eb8682764b58/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,410 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,410 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b74578a527e8a472b5e0eb8682764b58; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67963351, jitterRate=0.012732848525047302}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,410 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b74578a527e8a472b5e0eb8682764b58: Writing region info on filesystem at 1676203403394Initializing all the Stores at 1676203403395 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403395Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403395Region opened successfully at 1676203403410 (+15 ms) 2023-02-12 12:03:23,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b74578a527e8a472b5e0eb8682764b58, disabling compactions & flushes 2023-02-12 12:03:23,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:23,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:23,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. after waiting 0 ms 2023-02-12 12:03:23,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:23,447 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676203397684.b74578a527e8a472b5e0eb8682764b58. 2023-02-12 12:03:23,447 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b74578a527e8a472b5e0eb8682764b58: Waiting for close lock at 1676203403446Disabling compacts and flushes for region at 1676203403446Disabling writes for close at 1676203403446Writing region close event to WAL at 1676203403447 (+1 ms)Closed at 1676203403447 2023-02-12 12:03:23,450 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,450 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,452 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,453 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:23,454 DEBUG [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1 2023-02-12 12:03:23,455 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d06b98edd97b470ebe5c7bd4dc373b7f columnFamilyName f1 2023-02-12 12:03:23,459 DEBUG [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f1/testWithMapReduce=d06b98edd97b470ebe5c7bd4dc373b7f-204a296b97c447cbba598c7baaa5317b 2023-02-12 12:03:23,460 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(310): Store=d06b98edd97b470ebe5c7bd4dc373b7f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,460 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d06b98edd97b470ebe5c7bd4dc373b7f 2023-02-12 12:03:23,460 DEBUG [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2 2023-02-12 12:03:23,461 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d06b98edd97b470ebe5c7bd4dc373b7f columnFamilyName f2 2023-02-12 12:03:23,465 DEBUG [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/d06b98edd97b470ebe5c7bd4dc373b7f/f2/testWithMapReduce=d06b98edd97b470ebe5c7bd4dc373b7f-bc39f33fe37d417a869101ec85766890 2023-02-12 12:03:23,465 INFO [StoreOpener-d06b98edd97b470ebe5c7bd4dc373b7f-1] regionserver.HStore(310): Store=d06b98edd97b470ebe5c7bd4dc373b7f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,466 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d06b98edd97b470ebe5c7bd4dc373b7f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63480920, jitterRate=-0.05406057834625244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d06b98edd97b470ebe5c7bd4dc373b7f: Writing region info on filesystem at 1676203403452Initializing all the Stores at 1676203403453 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403453Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403453Region opened successfully at 1676203403466 (+13 ms) 2023-02-12 12:03:23,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d06b98edd97b470ebe5c7bd4dc373b7f, disabling compactions & flushes 2023-02-12 12:03:23,493 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:23,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:23,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. after waiting 0 ms 2023-02-12 12:03:23,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:23,494 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676203397684.d06b98edd97b470ebe5c7bd4dc373b7f. 2023-02-12 12:03:23,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d06b98edd97b470ebe5c7bd4dc373b7f: Waiting for close lock at 1676203403493Disabling compacts and flushes for region at 1676203403493Disabling writes for close at 1676203403493Writing region close event to WAL at 1676203403494 (+1 ms)Closed at 1676203403494 2023-02-12 12:03:23,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,497 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,498 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,500 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:23,501 DEBUG [StoreOpener-ae9f25198523ff4989772be17b20b711-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1 2023-02-12 12:03:23,501 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae9f25198523ff4989772be17b20b711 columnFamilyName f1 2023-02-12 12:03:23,507 DEBUG [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f1/testWithMapReduce=ae9f25198523ff4989772be17b20b711-82d9f99f0fe14f149dbee92c058a51bc 2023-02-12 12:03:23,507 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(310): Store=ae9f25198523ff4989772be17b20b711/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,507 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ae9f25198523ff4989772be17b20b711 2023-02-12 12:03:23,508 DEBUG [StoreOpener-ae9f25198523ff4989772be17b20b711-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2 2023-02-12 12:03:23,509 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae9f25198523ff4989772be17b20b711 columnFamilyName f2 2023-02-12 12:03:23,513 DEBUG [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/ae9f25198523ff4989772be17b20b711/f2/testWithMapReduce=ae9f25198523ff4989772be17b20b711-337244d18a9a4ff790bef0474d9b6a43 2023-02-12 12:03:23,513 INFO [StoreOpener-ae9f25198523ff4989772be17b20b711-1] regionserver.HStore(310): Store=ae9f25198523ff4989772be17b20b711/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,514 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ae9f25198523ff4989772be17b20b711; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73022269, jitterRate=0.0881166011095047}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,514 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ae9f25198523ff4989772be17b20b711: Writing region info on filesystem at 1676203403498Initializing all the Stores at 1676203403499 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403499Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403499Region opened successfully at 1676203403514 (+15 ms) 2023-02-12 12:03:23,555 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ae9f25198523ff4989772be17b20b711, disabling compactions & flushes 2023-02-12 12:03:23,556 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:23,556 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:23,556 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. after waiting 0 ms 2023-02-12 12:03:23,556 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:23,556 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676203397684.ae9f25198523ff4989772be17b20b711. 2023-02-12 12:03:23,557 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ae9f25198523ff4989772be17b20b711: Waiting for close lock at 1676203403555Disabling compacts and flushes for region at 1676203403555Disabling writes for close at 1676203403556 (+1 ms)Writing region close event to WAL at 1676203403556Closed at 1676203403556 2023-02-12 12:03:23,560 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,560 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,561 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,563 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:23,564 DEBUG [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1 2023-02-12 12:03:23,565 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fdbdad26d3d788587798ebf73be17d4 columnFamilyName f1 2023-02-12 12:03:23,569 DEBUG [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f1/testWithMapReduce=9fdbdad26d3d788587798ebf73be17d4-38cb989e413748828b57abb849a0f35c 2023-02-12 12:03:23,569 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(310): Store=9fdbdad26d3d788587798ebf73be17d4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,570 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9fdbdad26d3d788587798ebf73be17d4 2023-02-12 12:03:23,570 DEBUG [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2 2023-02-12 12:03:23,571 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fdbdad26d3d788587798ebf73be17d4 columnFamilyName f2 2023-02-12 12:03:23,574 DEBUG [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/9fdbdad26d3d788587798ebf73be17d4/f2/testWithMapReduce=9fdbdad26d3d788587798ebf73be17d4-39a939bd96a5498d95c077c3dea73e7f 2023-02-12 12:03:23,574 INFO [StoreOpener-9fdbdad26d3d788587798ebf73be17d4-1] regionserver.HStore(310): Store=9fdbdad26d3d788587798ebf73be17d4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,575 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9fdbdad26d3d788587798ebf73be17d4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64713024, jitterRate=-0.03570079803466797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9fdbdad26d3d788587798ebf73be17d4: Writing region info on filesystem at 1676203403562Initializing all the Stores at 1676203403562Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403563 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403563Region opened successfully at 1676203403575 (+12 ms) 2023-02-12 12:03:23,602 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9fdbdad26d3d788587798ebf73be17d4, disabling compactions & flushes 2023-02-12 12:03:23,603 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:23,603 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:23,603 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. after waiting 0 ms 2023-02-12 12:03:23,603 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:23,604 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676203397684.9fdbdad26d3d788587798ebf73be17d4. 2023-02-12 12:03:23,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9fdbdad26d3d788587798ebf73be17d4: Waiting for close lock at 1676203403602Disabling compacts and flushes for region at 1676203403602Disabling writes for close at 1676203403603 (+1 ms)Writing region close event to WAL at 1676203403604 (+1 ms)Closed at 1676203403604 2023-02-12 12:03:23,607 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:23,607 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:23,609 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:23,612 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:23,613 DEBUG [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1 2023-02-12 12:03:23,613 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd7eac03420b5d08ba5e8ed75de2df7e columnFamilyName f1 2023-02-12 12:03:23,617 DEBUG [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f1/testWithMapReduce=dd7eac03420b5d08ba5e8ed75de2df7e-f05ad870a7b24d65a75e1c6fcd2dda48 2023-02-12 12:03:23,618 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(310): Store=dd7eac03420b5d08ba5e8ed75de2df7e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,618 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dd7eac03420b5d08ba5e8ed75de2df7e 2023-02-12 12:03:23,619 DEBUG [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2 2023-02-12 12:03:23,619 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd7eac03420b5d08ba5e8ed75de2df7e columnFamilyName f2 2023-02-12 12:03:23,623 DEBUG [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(539): loaded hdfs://localhost:38661/user/jenkins/test-data/df18cb03-3ed0-7979-438a-6cbee9b7551d/testWithMapReduceAndOfflineHBaseMultiRegion/058f205b-caf1-47de-a476-443a4cb27c9c/data/default/testWithMapReduce/dd7eac03420b5d08ba5e8ed75de2df7e/f2/testWithMapReduce=dd7eac03420b5d08ba5e8ed75de2df7e-81cf0b483e9b4143be60f0b1481f582b 2023-02-12 12:03:23,623 INFO [StoreOpener-dd7eac03420b5d08ba5e8ed75de2df7e-1] regionserver.HStore(310): Store=dd7eac03420b5d08ba5e8ed75de2df7e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:23,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:23,624 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dd7eac03420b5d08ba5e8ed75de2df7e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65400168, jitterRate=-0.025461554527282715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:23,624 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dd7eac03420b5d08ba5e8ed75de2df7e: Writing region info on filesystem at 1676203403610Initializing all the Stores at 1676203403610Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403610Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203403611 (+1 ms)Region opened successfully at 1676203403624 (+13 ms) 2023-02-12 12:03:23,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dd7eac03420b5d08ba5e8ed75de2df7e, disabling compactions & flushes 2023-02-12 12:03:23,653 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:23,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:23,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. after waiting 0 ms 2023-02-12 12:03:23,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:23,654 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676203397684.dd7eac03420b5d08ba5e8ed75de2df7e. 2023-02-12 12:03:23,654 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dd7eac03420b5d08ba5e8ed75de2df7e: Waiting for close lock at 1676203403653Disabling compacts and flushes for region at 1676203403653Disabling writes for close at 1676203403653Writing region close event to WAL at 1676203403654 (+1 ms)Closed at 1676203403654 2023-02-12 12:03:23,759 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 12:03:24,070 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 12:03:24,070 WARN [Listener at localhost/42921] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:24,075 INFO [Listener at localhost/42921] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:24,142 WARN [BP-529207973-172.31.14.131-1676203394564 heartbeating to localhost/127.0.0.1:38661] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-529207973-172.31.14.131-1676203394564 (Datanode Uuid 93dac768-21ba-47c6-9cb7-58b504daea19) service to localhost/127.0.0.1:38661 2023-02-12 12:03:24,143 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/cluster_f10b72fc-55b3-d1b2-5a10-135fc6be91fa/dfs/data/data3/current/BP-529207973-172.31.14.131-1676203394564] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:24,143 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/cluster_f10b72fc-55b3-d1b2-5a10-135fc6be91fa/dfs/data/data4/current/BP-529207973-172.31.14.131-1676203394564] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:24,182 WARN [Listener at localhost/42921] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:24,185 INFO [Listener at localhost/42921] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:24,287 WARN [BP-529207973-172.31.14.131-1676203394564 heartbeating to localhost/127.0.0.1:38661] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:24,287 WARN [BP-529207973-172.31.14.131-1676203394564 heartbeating to localhost/127.0.0.1:38661] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-529207973-172.31.14.131-1676203394564 (Datanode Uuid c531b5c7-d43e-4851-bf41-68babf35d0f5) service to localhost/127.0.0.1:38661 2023-02-12 12:03:24,288 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/cluster_f10b72fc-55b3-d1b2-5a10-135fc6be91fa/dfs/data/data1/current/BP-529207973-172.31.14.131-1676203394564] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:24,288 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/cluster_f10b72fc-55b3-d1b2-5a10-135fc6be91fa/dfs/data/data2/current/BP-529207973-172.31.14.131-1676203394564] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:24,298 INFO [Listener at localhost/42921] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:24,418 INFO [Listener at localhost/42921] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 12:03:24,465 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 12:03:24,477 INFO [Listener at localhost/42921] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=155 (was 104) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:38661 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:38661 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,44927,1676203395274)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38661 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/42921 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:38661 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:38661 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:38661 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:38661 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=537 (was 547), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=343 (was 314) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=4214 (was 4401) 2023-02-12 12:03:24,487 INFO [Listener at localhost/42921] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=155, OpenFileDescriptor=537, MaxFileDescriptor=60000, SystemLoadAverage=343, ProcessCount=166, AvailableMemoryMB=4213 2023-02-12 12:03:24,497 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/hadoop.log.dir so I do NOT create it in target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1 2023-02-12 12:03:24,497 WARN [Listener at localhost/42921] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/hadoop.tmp.dir so I do NOT create it in target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1 2023-02-12 12:03:24,498 WARN [Listener at localhost/42921] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7942e900-7232-f18f-ea53-8fca515a7995/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 12:03:24,498 DEBUG [Listener at localhost/42921] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/cluster_b9026805-dd4d-4bd1-3b44-fa93ddf1e5c5, deleteOnExit=true 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/test.cache.data in system properties and HBase conf 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/hadoop.log.dir in system properties and HBase conf 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 12:03:24,498 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 12:03:24,499 DEBUG [Listener at localhost/42921] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 12:03:24,499 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:24,499 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:24,499 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 12:03:24,499 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:24,499 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 12:03:24,499 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 12:03:24,499 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:24,499 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:24,500 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 12:03:24,500 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/nfs.dump.dir in system properties and HBase conf 2023-02-12 12:03:24,500 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/java.io.tmpdir in system properties and HBase conf 2023-02-12 12:03:24,500 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:24,500 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 12:03:24,500 INFO [Listener at localhost/42921] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 12:03:24,504 WARN [Listener at localhost/42921] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:24,504 WARN [Listener at localhost/42921] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:24,547 WARN [Listener at localhost/42921] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:24,550 INFO [Listener at localhost/42921] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:24,555 INFO [Listener at localhost/42921] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/java.io.tmpdir/Jetty_localhost_44949_hdfs____tfe08/webapp 2023-02-12 12:03:24,647 INFO [Listener at localhost/42921] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44949 2023-02-12 12:03:24,651 WARN [Listener at localhost/42921] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:24,651 WARN [Listener at localhost/42921] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:24,696 WARN [Listener at localhost/40331] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:24,707 WARN [Listener at localhost/40331] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:24,709 WARN [Listener at localhost/40331] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:24,710 INFO [Listener at localhost/40331] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:24,714 INFO [Listener at localhost/40331] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/java.io.tmpdir/Jetty_localhost_38743_datanode____.lamcdk/webapp 2023-02-12 12:03:24,805 INFO [Listener at localhost/40331] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38743 2023-02-12 12:03:24,813 WARN [Listener at localhost/38163] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:24,826 WARN [Listener at localhost/38163] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:24,829 WARN [Listener at localhost/38163] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:24,830 INFO [Listener at localhost/38163] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:24,835 INFO [Listener at localhost/38163] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/java.io.tmpdir/Jetty_localhost_34361_datanode____.n8ixyk/webapp 2023-02-12 12:03:24,912 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfff27bb3f1f50444: Processing first storage report for DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98 from datanode daa01354-b935-4d80-ba7e-db6834013482 2023-02-12 12:03:24,912 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfff27bb3f1f50444: from storage DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98 node DatanodeRegistration(127.0.0.1:41685, datanodeUuid=daa01354-b935-4d80-ba7e-db6834013482, infoPort=46009, infoSecurePort=0, ipcPort=38163, storageInfo=lv=-57;cid=testClusterID;nsid=744233274;c=1676203404507), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:24,912 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfff27bb3f1f50444: Processing first storage report for DS-b5b7f1e8-ab98-4ba1-bd93-b1435e699628 from datanode daa01354-b935-4d80-ba7e-db6834013482 2023-02-12 12:03:24,912 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfff27bb3f1f50444: from storage DS-b5b7f1e8-ab98-4ba1-bd93-b1435e699628 node DatanodeRegistration(127.0.0.1:41685, datanodeUuid=daa01354-b935-4d80-ba7e-db6834013482, infoPort=46009, infoSecurePort=0, ipcPort=38163, storageInfo=lv=-57;cid=testClusterID;nsid=744233274;c=1676203404507), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:24,934 INFO [Listener at localhost/38163] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34361 2023-02-12 12:03:24,943 WARN [Listener at localhost/33679] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:25,034 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77340ce9333bb547: Processing first storage report for DS-66074762-1f47-4cd2-9818-07cb2b718c5d from datanode dc714616-d2a5-4f36-b3a9-736796fd0633 2023-02-12 12:03:25,034 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77340ce9333bb547: from storage DS-66074762-1f47-4cd2-9818-07cb2b718c5d node DatanodeRegistration(127.0.0.1:34603, datanodeUuid=dc714616-d2a5-4f36-b3a9-736796fd0633, infoPort=37695, infoSecurePort=0, ipcPort=33679, storageInfo=lv=-57;cid=testClusterID;nsid=744233274;c=1676203404507), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:25,034 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x77340ce9333bb547: Processing first storage report for DS-4bfea0c8-b081-47ac-8d68-e87016a452c9 from datanode dc714616-d2a5-4f36-b3a9-736796fd0633 2023-02-12 12:03:25,034 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x77340ce9333bb547: from storage DS-4bfea0c8-b081-47ac-8d68-e87016a452c9 node DatanodeRegistration(127.0.0.1:34603, datanodeUuid=dc714616-d2a5-4f36-b3a9-736796fd0633, infoPort=37695, infoSecurePort=0, ipcPort=33679, storageInfo=lv=-57;cid=testClusterID;nsid=744233274;c=1676203404507), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:25,053 DEBUG [Listener at localhost/33679] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1 2023-02-12 12:03:25,056 INFO [Listener at localhost/33679] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/cluster_b9026805-dd4d-4bd1-3b44-fa93ddf1e5c5/zookeeper_0, clientPort=49203, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/cluster_b9026805-dd4d-4bd1-3b44-fa93ddf1e5c5/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/cluster_b9026805-dd4d-4bd1-3b44-fa93ddf1e5c5/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 12:03:25,057 INFO [Listener at localhost/33679] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49203 2023-02-12 12:03:25,057 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,058 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,070 INFO [Listener at localhost/33679] util.FSUtils(479): Created version file at hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba with version=8 2023-02-12 12:03:25,070 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,071 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,072 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40331/user/jenkins/test-data/38317be6-f6c2-e365-a330-acb781cf52b8/hbase-staging 2023-02-12 12:03:25,073 INFO [Listener at localhost/33679] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:25,074 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:25,074 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:25,074 INFO [Listener at localhost/33679] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:25,074 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:25,074 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:25,074 INFO [Listener at localhost/33679] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:25,076 INFO [Listener at localhost/33679] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42711 2023-02-12 12:03:25,076 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,077 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,078 INFO [Listener at localhost/33679] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42711 connecting to ZooKeeper ensemble=127.0.0.1:49203 2023-02-12 12:03:25,085 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:427110x0, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:25,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42711-0x100486a18c40000 connected 2023-02-12 12:03:25,103 DEBUG [Listener at localhost/33679] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:25,103 DEBUG [Listener at localhost/33679] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:25,104 DEBUG [Listener at localhost/33679] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:25,105 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42711 2023-02-12 12:03:25,105 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42711 2023-02-12 12:03:25,105 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42711 2023-02-12 12:03:25,108 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42711 2023-02-12 12:03:25,108 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42711 2023-02-12 12:03:25,108 INFO [Listener at localhost/33679] master.HMaster(439): hbase.rootdir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba, hbase.cluster.distributed=false 2023-02-12 12:03:25,120 INFO [Listener at localhost/33679] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:25,120 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:25,120 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:25,120 INFO [Listener at localhost/33679] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:25,120 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:25,120 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:25,120 INFO [Listener at localhost/33679] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:25,122 INFO [Listener at localhost/33679] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43541 2023-02-12 12:03:25,122 INFO [Listener at localhost/33679] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:25,128 DEBUG [Listener at localhost/33679] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:25,128 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,129 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,130 INFO [Listener at localhost/33679] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43541 connecting to ZooKeeper ensemble=127.0.0.1:49203 2023-02-12 12:03:25,133 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:435410x0, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:25,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43541-0x100486a18c40001 connected 2023-02-12 12:03:25,134 DEBUG [Listener at localhost/33679] zookeeper.ZKUtil(164): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:25,135 DEBUG [Listener at localhost/33679] zookeeper.ZKUtil(164): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:25,135 DEBUG [Listener at localhost/33679] zookeeper.ZKUtil(164): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:25,137 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43541 2023-02-12 12:03:25,137 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43541 2023-02-12 12:03:25,138 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43541 2023-02-12 12:03:25,140 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43541 2023-02-12 12:03:25,144 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43541 2023-02-12 12:03:25,154 INFO [Listener at localhost/33679] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:25,155 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:25,155 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:25,155 INFO [Listener at localhost/33679] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:25,155 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:25,155 INFO [Listener at localhost/33679] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:25,155 INFO [Listener at localhost/33679] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:25,158 INFO [Listener at localhost/33679] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38607 2023-02-12 12:03:25,158 INFO [Listener at localhost/33679] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:25,162 DEBUG [Listener at localhost/33679] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:25,162 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,164 INFO [Listener at localhost/33679] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,165 INFO [Listener at localhost/33679] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38607 connecting to ZooKeeper ensemble=127.0.0.1:49203 2023-02-12 12:03:25,168 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:386070x0, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:25,170 DEBUG [Listener at localhost/33679] zookeeper.ZKUtil(164): regionserver:386070x0, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:25,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38607-0x100486a18c40002 connected 2023-02-12 12:03:25,171 DEBUG [Listener at localhost/33679] zookeeper.ZKUtil(164): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:25,172 DEBUG [Listener at localhost/33679] zookeeper.ZKUtil(164): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:25,173 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38607 2023-02-12 12:03:25,173 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38607 2023-02-12 12:03:25,176 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38607 2023-02-12 12:03:25,177 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38607 2023-02-12 12:03:25,177 DEBUG [Listener at localhost/33679] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38607 2023-02-12 12:03:25,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:25,180 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:25,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:25,181 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:25,181 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:25,181 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:25,182 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:25,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:25,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42711,1676203405073 from backup master directory 2023-02-12 12:03:25,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:25,185 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:25,185 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:25,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:25,185 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:25,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/hbase.id with ID: 09058cd0-c61d-4de3-bdc9-bec2d9b6babc 2023-02-12 12:03:25,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:25,212 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:25,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x76a6cd2c to 127.0.0.1:49203 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:25,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46adc03e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:25,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:25,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 12:03:25,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:25,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/data/master/store-tmp 2023-02-12 12:03:25,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:25,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:25,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:25,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:25,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:25,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:25,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:25,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203405242Disabling compacts and flushes for region at 1676203405242Disabling writes for close at 1676203405242Writing region close event to WAL at 1676203405242Closed at 1676203405242 2023-02-12 12:03:25,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/WALs/jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:25,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42711%2C1676203405073, suffix=, logDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/WALs/jenkins-hbase4.apache.org,42711,1676203405073, archiveDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/oldWALs, maxLogs=10 2023-02-12 12:03:25,259 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41685,DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98,DISK] 2023-02-12 12:03:25,260 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-66074762-1f47-4cd2-9818-07cb2b718c5d,DISK] 2023-02-12 12:03:25,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/WALs/jenkins-hbase4.apache.org,42711,1676203405073/jenkins-hbase4.apache.org%2C42711%2C1676203405073.1676203405245 2023-02-12 12:03:25,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41685,DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98,DISK], DatanodeInfoWithStorage[127.0.0.1:34603,DS-66074762-1f47-4cd2-9818-07cb2b718c5d,DISK]] 2023-02-12 12:03:25,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:25,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:25,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:25,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:25,266 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:25,267 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 12:03:25,267 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 12:03:25,268 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:25,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:25,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:25,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:25,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:25,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75114960, jitterRate=0.11930012702941895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:25,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676203405265Initializing all the Stores at 1676203405265Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203405265Cleaning up temporary data from old regions at 1676203405269 (+4 ms)Cleaning up detritus from prior splits at 1676203405269Region opened successfully at 1676203405273 (+4 ms) 2023-02-12 12:03:25,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 12:03:25,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 12:03:25,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 12:03:25,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 12:03:25,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 12:03:25,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 12:03:25,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 12:03:25,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 12:03:25,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 12:03:25,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 12:03:25,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 12:03:25,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 12:03:25,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 12:03:25,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 12:03:25,290 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:25,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 12:03:25,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 12:03:25,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 12:03:25,292 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:25,292 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:25,292 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:25,292 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:25,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42711,1676203405073, sessionid=0x100486a18c40000, setting cluster-up flag (Was=false) 2023-02-12 12:03:25,298 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:25,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 12:03:25,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:25,305 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:25,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 12:03:25,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:25,310 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.hbase-snapshot/.tmp 2023-02-12 12:03:25,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:25,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:25,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:25,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:25,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:25,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 12:03:25,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:25,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676203435315 2023-02-12 12:03:25,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 12:03:25,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 12:03:25,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 12:03:25,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 12:03:25,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 12:03:25,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 12:03:25,315 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:25,316 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 12:03:25,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 12:03:25,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 12:03:25,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 12:03:25,317 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:25,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 12:03:25,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 12:03:25,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203405352,5,FailOnTimeoutGroup] 2023-02-12 12:03:25,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203405357,5,FailOnTimeoutGroup] 2023-02-12 12:03:25,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 12:03:25,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,366 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:25,367 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:25,367 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba 2023-02-12 12:03:25,375 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:25,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:25,377 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/info 2023-02-12 12:03:25,377 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:25,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:25,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:25,379 INFO [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(952): ClusterId : 09058cd0-c61d-4de3-bdc9-bec2d9b6babc 2023-02-12 12:03:25,379 DEBUG [RS:0;jenkins-hbase4:43541] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:25,379 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:25,380 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:25,381 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:25,381 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:25,382 DEBUG [RS:0;jenkins-hbase4:43541] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:25,382 DEBUG [RS:0;jenkins-hbase4:43541] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:25,382 INFO [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(952): ClusterId : 09058cd0-c61d-4de3-bdc9-bec2d9b6babc 2023-02-12 12:03:25,382 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/table 2023-02-12 12:03:25,382 DEBUG [RS:1;jenkins-hbase4:38607] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:25,383 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:25,383 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:25,384 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740 2023-02-12 12:03:25,384 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740 2023-02-12 12:03:25,385 DEBUG [RS:0;jenkins-hbase4:43541] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:25,386 DEBUG [RS:1;jenkins-hbase4:38607] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:25,386 DEBUG [RS:1;jenkins-hbase4:38607] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:25,386 DEBUG [RS:0;jenkins-hbase4:43541] zookeeper.ReadOnlyZKClient(139): Connect 0x0a4f1f20 to 127.0.0.1:49203 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:25,387 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:25,388 DEBUG [RS:1;jenkins-hbase4:38607] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:25,389 DEBUG [RS:1;jenkins-hbase4:38607] zookeeper.ReadOnlyZKClient(139): Connect 0x41c4b98f to 127.0.0.1:49203 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:25,390 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:25,393 DEBUG [RS:0;jenkins-hbase4:43541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@488e019, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:25,393 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:25,393 DEBUG [RS:1;jenkins-hbase4:38607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f035fc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:25,393 DEBUG [RS:0;jenkins-hbase4:43541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b77450, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:25,393 DEBUG [RS:1;jenkins-hbase4:38607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b3cd2ff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:25,394 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70350710, jitterRate=0.04830726981163025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:25,394 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676203405375Initializing all the Stores at 1676203405375Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203405375Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203405375Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203405375Cleaning up temporary data from old regions at 1676203405385 (+10 ms)Cleaning up detritus from prior splits at 1676203405386 (+1 ms)Region opened successfully at 1676203405394 (+8 ms) 2023-02-12 12:03:25,394 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:25,394 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:25,394 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:25,394 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:25,394 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:25,394 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:25,394 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203405394Disabling compacts and flushes for region at 1676203405394Disabling writes for close at 1676203405394Writing region close event to WAL at 1676203405394Closed at 1676203405394 2023-02-12 12:03:25,395 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:25,395 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 12:03:25,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 12:03:25,398 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 12:03:25,399 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 12:03:25,404 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38607 2023-02-12 12:03:25,404 INFO [RS:1;jenkins-hbase4:38607] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:25,404 INFO [RS:1;jenkins-hbase4:38607] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:25,404 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:25,404 INFO [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42711,1676203405073 with isa=jenkins-hbase4.apache.org/172.31.14.131:38607, startcode=1676203405154 2023-02-12 12:03:25,404 DEBUG [RS:1;jenkins-hbase4:38607] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:25,405 DEBUG [RS:0;jenkins-hbase4:43541] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43541 2023-02-12 12:03:25,406 INFO [RS:0;jenkins-hbase4:43541] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:25,406 INFO [RS:0;jenkins-hbase4:43541] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:25,406 DEBUG [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:25,406 INFO [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42711,1676203405073 with isa=jenkins-hbase4.apache.org/172.31.14.131:43541, startcode=1676203405119 2023-02-12 12:03:25,406 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60865, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:25,406 DEBUG [RS:0;jenkins-hbase4:43541] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:25,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:25,408 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba 2023-02-12 12:03:25,408 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40331 2023-02-12 12:03:25,408 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:25,409 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50161, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:25,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:25,410 DEBUG [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba 2023-02-12 12:03:25,410 DEBUG [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40331 2023-02-12 12:03:25,410 DEBUG [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:25,411 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:25,418 DEBUG [RS:1;jenkins-hbase4:38607] zookeeper.ZKUtil(162): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:25,418 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38607,1676203405154] 2023-02-12 12:03:25,419 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43541,1676203405119] 2023-02-12 12:03:25,419 WARN [RS:1;jenkins-hbase4:38607] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:25,419 DEBUG [RS:0;jenkins-hbase4:43541] zookeeper.ZKUtil(162): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:25,419 INFO [RS:1;jenkins-hbase4:38607] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:25,419 WARN [RS:0;jenkins-hbase4:43541] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:25,419 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/WALs/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:25,419 INFO [RS:0;jenkins-hbase4:43541] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:25,419 DEBUG [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/WALs/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:25,423 DEBUG [RS:0;jenkins-hbase4:43541] zookeeper.ZKUtil(162): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:25,423 DEBUG [RS:1;jenkins-hbase4:38607] zookeeper.ZKUtil(162): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:25,424 DEBUG [RS:0;jenkins-hbase4:43541] zookeeper.ZKUtil(162): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:25,424 DEBUG [RS:1;jenkins-hbase4:38607] zookeeper.ZKUtil(162): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:25,425 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:25,425 DEBUG [RS:0;jenkins-hbase4:43541] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:25,425 INFO [RS:1;jenkins-hbase4:38607] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:25,425 INFO [RS:0;jenkins-hbase4:43541] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:25,426 INFO [RS:1;jenkins-hbase4:38607] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:25,428 INFO [RS:1;jenkins-hbase4:38607] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:25,428 INFO [RS:0;jenkins-hbase4:43541] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:25,428 INFO [RS:1;jenkins-hbase4:38607] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,428 INFO [RS:0;jenkins-hbase4:43541] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:25,428 INFO [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:25,428 INFO [RS:0;jenkins-hbase4:43541] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,429 INFO [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:25,430 INFO [RS:1;jenkins-hbase4:38607] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,430 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,430 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,430 INFO [RS:0;jenkins-hbase4:43541] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,430 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,430 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,430 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,430 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,430 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:25,431 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:25,431 DEBUG [RS:1;jenkins-hbase4:38607] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,431 DEBUG [RS:0;jenkins-hbase4:43541] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:25,436 INFO [RS:1;jenkins-hbase4:38607] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,436 INFO [RS:1;jenkins-hbase4:38607] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,436 INFO [RS:1;jenkins-hbase4:38607] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,436 INFO [RS:0;jenkins-hbase4:43541] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,436 INFO [RS:0;jenkins-hbase4:43541] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,436 INFO [RS:0;jenkins-hbase4:43541] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,453 INFO [RS:0;jenkins-hbase4:43541] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:25,453 INFO [RS:1;jenkins-hbase4:38607] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:25,453 INFO [RS:0;jenkins-hbase4:43541] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43541,1676203405119-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,453 INFO [RS:1;jenkins-hbase4:38607] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38607,1676203405154-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,469 INFO [RS:1;jenkins-hbase4:38607] regionserver.Replication(203): jenkins-hbase4.apache.org,38607,1676203405154 started 2023-02-12 12:03:25,469 INFO [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38607,1676203405154, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38607, sessionid=0x100486a18c40002 2023-02-12 12:03:25,469 INFO [RS:0;jenkins-hbase4:43541] regionserver.Replication(203): jenkins-hbase4.apache.org,43541,1676203405119 started 2023-02-12 12:03:25,469 DEBUG [RS:1;jenkins-hbase4:38607] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:25,469 DEBUG [RS:1;jenkins-hbase4:38607] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:25,469 INFO [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43541,1676203405119, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43541, sessionid=0x100486a18c40001 2023-02-12 12:03:25,469 DEBUG [RS:1;jenkins-hbase4:38607] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38607,1676203405154' 2023-02-12 12:03:25,470 DEBUG [RS:0;jenkins-hbase4:43541] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:25,470 DEBUG [RS:0;jenkins-hbase4:43541] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:25,470 DEBUG [RS:0;jenkins-hbase4:43541] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43541,1676203405119' 2023-02-12 12:03:25,470 DEBUG [RS:0;jenkins-hbase4:43541] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:25,470 DEBUG [RS:1;jenkins-hbase4:38607] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:25,470 DEBUG [RS:1;jenkins-hbase4:38607] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:25,470 DEBUG [RS:0;jenkins-hbase4:43541] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:25,470 DEBUG [RS:1;jenkins-hbase4:38607] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:25,470 DEBUG [RS:1;jenkins-hbase4:38607] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:25,470 DEBUG [RS:0;jenkins-hbase4:43541] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:25,470 DEBUG [RS:0;jenkins-hbase4:43541] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:25,471 DEBUG [RS:0;jenkins-hbase4:43541] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:25,470 DEBUG [RS:1;jenkins-hbase4:38607] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:25,471 DEBUG [RS:1;jenkins-hbase4:38607] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38607,1676203405154' 2023-02-12 12:03:25,471 DEBUG [RS:0;jenkins-hbase4:43541] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43541,1676203405119' 2023-02-12 12:03:25,471 DEBUG [RS:0;jenkins-hbase4:43541] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:25,471 DEBUG [RS:1;jenkins-hbase4:38607] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:25,471 DEBUG [RS:1;jenkins-hbase4:38607] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:25,471 DEBUG [RS:0;jenkins-hbase4:43541] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:25,471 DEBUG [RS:1;jenkins-hbase4:38607] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:25,471 DEBUG [RS:0;jenkins-hbase4:43541] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:25,471 INFO [RS:1;jenkins-hbase4:38607] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:25,471 INFO [RS:0;jenkins-hbase4:43541] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:25,471 INFO [RS:1;jenkins-hbase4:38607] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:25,471 INFO [RS:0;jenkins-hbase4:43541] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:25,549 DEBUG [jenkins-hbase4:42711] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 12:03:25,549 DEBUG [jenkins-hbase4:42711] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:25,551 DEBUG [jenkins-hbase4:42711] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:25,551 DEBUG [jenkins-hbase4:42711] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:25,551 DEBUG [jenkins-hbase4:42711] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:25,552 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38607,1676203405154, state=OPENING 2023-02-12 12:03:25,553 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 12:03:25,555 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:25,556 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:25,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38607,1676203405154}] 2023-02-12 12:03:25,724 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:25,724 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:25,726 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39702, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:25,748 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 12:03:25,748 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:25,750 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38607%2C1676203405154.meta, suffix=.meta, logDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/WALs/jenkins-hbase4.apache.org,38607,1676203405154, archiveDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/oldWALs, maxLogs=32 2023-02-12 12:03:25,789 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41685,DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98,DISK] 2023-02-12 12:03:25,789 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-66074762-1f47-4cd2-9818-07cb2b718c5d,DISK] 2023-02-12 12:03:25,791 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/WALs/jenkins-hbase4.apache.org,38607,1676203405154/jenkins-hbase4.apache.org%2C38607%2C1676203405154.meta.1676203405751.meta 2023-02-12 12:03:25,791 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41685,DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98,DISK], DatanodeInfoWithStorage[127.0.0.1:34603,DS-66074762-1f47-4cd2-9818-07cb2b718c5d,DISK]] 2023-02-12 12:03:25,791 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:25,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 12:03:25,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 12:03:25,792 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 12:03:25,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 12:03:25,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:25,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 12:03:25,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 12:03:25,794 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:25,795 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/info 2023-02-12 12:03:25,795 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/info 2023-02-12 12:03:25,795 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:25,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:25,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:25,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:25,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:25,797 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:25,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:25,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:25,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/table 2023-02-12 12:03:25,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/table 2023-02-12 12:03:25,798 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:25,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:25,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740 2023-02-12 12:03:25,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740 2023-02-12 12:03:25,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:25,804 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:25,805 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71001441, jitterRate=0.05800391733646393}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:25,805 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676203405793Writing region info on filesystem at 1676203405793Initializing all the Stores at 1676203405793Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203405793Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203405794 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203405794Cleaning up temporary data from old regions at 1676203405802 (+8 ms)Cleaning up detritus from prior splits at 1676203405802Running coprocessor post-open hooks at 1676203405805 (+3 ms)Region opened successfully at 1676203405805 2023-02-12 12:03:25,805 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676203405724 2023-02-12 12:03:25,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 12:03:25,810 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 12:03:25,810 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38607,1676203405154, state=OPEN 2023-02-12 12:03:25,811 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 12:03:25,811 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:25,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 12:03:25,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38607,1676203405154 in 255 msec 2023-02-12 12:03:25,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 12:03:25,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 418 msec 2023-02-12 12:03:25,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 505 msec 2023-02-12 12:03:25,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676203405180, completionTime=-1 2023-02-12 12:03:25,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 12:03:25,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 12:03:25,820 DEBUG [hconnection-0x7d2b0669-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:25,821 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39706, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:25,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 12:03:25,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676203465823 2023-02-12 12:03:25,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676203525823 2023-02-12 12:03:25,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-12 12:03:25,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42711,1676203405073-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42711,1676203405073-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42711,1676203405073-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42711, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:25,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 12:03:25,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:25,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 12:03:25,833 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 12:03:25,834 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:25,834 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:25,836 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:25,837 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394 empty. 2023-02-12 12:03:25,837 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:25,837 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 12:03:25,848 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:25,849 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a7e695b43eeadb3d24115dfc624f0394, NAME => 'hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp 2023-02-12 12:03:25,857 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:25,858 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a7e695b43eeadb3d24115dfc624f0394, disabling compactions & flushes 2023-02-12 12:03:25,858 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:25,858 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:25,858 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. after waiting 0 ms 2023-02-12 12:03:25,858 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:25,858 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:25,858 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a7e695b43eeadb3d24115dfc624f0394: Waiting for close lock at 1676203405858Disabling compacts and flushes for region at 1676203405858Disabling writes for close at 1676203405858Writing region close event to WAL at 1676203405858Closed at 1676203405858 2023-02-12 12:03:25,860 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:25,861 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203405861"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203405861"}]},"ts":"1676203405861"} 2023-02-12 12:03:25,863 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:25,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:25,864 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203405864"}]},"ts":"1676203405864"} 2023-02-12 12:03:25,865 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 12:03:25,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:25,869 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:25,869 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:25,869 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:25,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a7e695b43eeadb3d24115dfc624f0394, ASSIGN}] 2023-02-12 12:03:25,872 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a7e695b43eeadb3d24115dfc624f0394, ASSIGN 2023-02-12 12:03:25,872 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a7e695b43eeadb3d24115dfc624f0394, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43541,1676203405119; forceNewPlan=false, retain=false 2023-02-12 12:03:26,023 INFO [jenkins-hbase4:42711] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:26,024 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a7e695b43eeadb3d24115dfc624f0394, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:26,024 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203406024"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203406024"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203406024"}]},"ts":"1676203406024"} 2023-02-12 12:03:26,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a7e695b43eeadb3d24115dfc624f0394, server=jenkins-hbase4.apache.org,43541,1676203405119}] 2023-02-12 12:03:26,178 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:26,178 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:26,180 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44122, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:26,184 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:26,188 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43541%2C1676203405119, suffix=, logDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/WALs/jenkins-hbase4.apache.org,43541,1676203405119, archiveDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/oldWALs, maxLogs=32 2023-02-12 12:03:26,204 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41685,DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98,DISK] 2023-02-12 12:03:26,204 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-66074762-1f47-4cd2-9818-07cb2b718c5d,DISK] 2023-02-12 12:03:26,206 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/WALs/jenkins-hbase4.apache.org,43541,1676203405119/jenkins-hbase4.apache.org%2C43541%2C1676203405119.1676203406188 2023-02-12 12:03:26,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41685,DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98,DISK], DatanodeInfoWithStorage[127.0.0.1:34603,DS-66074762-1f47-4cd2-9818-07cb2b718c5d,DISK]] 2023-02-12 12:03:26,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a7e695b43eeadb3d24115dfc624f0394, NAME => 'hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:26,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:26,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:26,206 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:26,207 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:26,208 INFO [StoreOpener-a7e695b43eeadb3d24115dfc624f0394-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:26,209 DEBUG [StoreOpener-a7e695b43eeadb3d24115dfc624f0394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394/info 2023-02-12 12:03:26,210 DEBUG [StoreOpener-a7e695b43eeadb3d24115dfc624f0394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394/info 2023-02-12 12:03:26,210 INFO [StoreOpener-a7e695b43eeadb3d24115dfc624f0394-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7e695b43eeadb3d24115dfc624f0394 columnFamilyName info 2023-02-12 12:03:26,211 INFO [StoreOpener-a7e695b43eeadb3d24115dfc624f0394-1] regionserver.HStore(310): Store=a7e695b43eeadb3d24115dfc624f0394/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:26,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:26,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:26,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:26,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:26,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a7e695b43eeadb3d24115dfc624f0394; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62137302, jitterRate=-0.07408204674720764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:26,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a7e695b43eeadb3d24115dfc624f0394: Running coprocessor pre-open hook at 1676203406207Writing region info on filesystem at 1676203406207Initializing all the Stores at 1676203406207Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203406207Cleaning up temporary data from old regions at 1676203406212 (+5 ms)Cleaning up detritus from prior splits at 1676203406212Running coprocessor post-open hooks at 1676203406216 (+4 ms)Region opened successfully at 1676203406216 2023-02-12 12:03:26,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394., pid=6, masterSystemTime=1676203406178 2023-02-12 12:03:26,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:26,220 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:26,220 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a7e695b43eeadb3d24115dfc624f0394, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:26,220 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203406220"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203406220"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203406220"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203406220"}]},"ts":"1676203406220"} 2023-02-12 12:03:26,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 12:03:26,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a7e695b43eeadb3d24115dfc624f0394, server=jenkins-hbase4.apache.org,43541,1676203405119 in 195 msec 2023-02-12 12:03:26,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 12:03:26,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a7e695b43eeadb3d24115dfc624f0394, ASSIGN in 354 msec 2023-02-12 12:03:26,225 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:26,225 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203406225"}]},"ts":"1676203406225"} 2023-02-12 12:03:26,227 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 12:03:26,229 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:26,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 397 msec 2023-02-12 12:03:26,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 12:03:26,234 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:26,235 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:26,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:26,239 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:26,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 12:03:26,249 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:26,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-12 12:03:26,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 12:03:26,268 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:26,270 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-12 12:03:26,276 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 12:03:26,278 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 12:03:26,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.093sec 2023-02-12 12:03:26,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 12:03:26,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 12:03:26,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 12:03:26,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42711,1676203405073-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 12:03:26,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42711,1676203405073-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 12:03:26,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 12:03:26,282 DEBUG [Listener at localhost/33679] zookeeper.ReadOnlyZKClient(139): Connect 0x44113cd6 to 127.0.0.1:49203 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:26,287 DEBUG [Listener at localhost/33679] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@340f7d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:26,288 DEBUG [hconnection-0x5f67a438-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:26,290 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39720, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:26,291 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:26,291 DEBUG [Listener at localhost/33679] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 12:03:26,293 DEBUG [Listener at localhost/33679] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 12:03:26,295 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51518, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 12:03:26,295 INFO [Listener at localhost/33679] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:26,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:26,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 12:03:26,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:51518 deadline: 1676203466296, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:26,297 INFO [Listener at localhost/33679] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 12:03:26,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:26,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:26,302 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:26,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-12 12:03:26,302 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:26,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:26,304 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,305 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456 empty. 2023-02-12 12:03:26,305 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 12:03:26,315 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:26,316 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => bbd58b83fa40eafd5f50ca45cc57b456, NAME => 'testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp 2023-02-12 12:03:26,328 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:26,329 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing bbd58b83fa40eafd5f50ca45cc57b456, disabling compactions & flushes 2023-02-12 12:03:26,329 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:26,329 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:26,329 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. after waiting 0 ms 2023-02-12 12:03:26,329 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:26,329 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:26,329 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for bbd58b83fa40eafd5f50ca45cc57b456: Waiting for close lock at 1676203406329Disabling compacts and flushes for region at 1676203406329Disabling writes for close at 1676203406329Writing region close event to WAL at 1676203406329Closed at 1676203406329 2023-02-12 12:03:26,331 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:26,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676203406332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203406332"}]},"ts":"1676203406332"} 2023-02-12 12:03:26,334 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:26,334 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:26,334 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203406334"}]},"ts":"1676203406334"} 2023-02-12 12:03:26,336 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-12 12:03:26,339 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:26,339 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:26,339 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:26,340 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:26,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bbd58b83fa40eafd5f50ca45cc57b456, ASSIGN}] 2023-02-12 12:03:26,341 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bbd58b83fa40eafd5f50ca45cc57b456, ASSIGN 2023-02-12 12:03:26,342 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bbd58b83fa40eafd5f50ca45cc57b456, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38607,1676203405154; forceNewPlan=false, retain=false 2023-02-12 12:03:26,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:26,473 INFO [RS:1;jenkins-hbase4:38607] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38607%2C1676203405154, suffix=, logDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/WALs/jenkins-hbase4.apache.org,38607,1676203405154, archiveDir=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/oldWALs, maxLogs=32 2023-02-12 12:03:26,488 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41685,DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98,DISK] 2023-02-12 12:03:26,488 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34603,DS-66074762-1f47-4cd2-9818-07cb2b718c5d,DISK] 2023-02-12 12:03:26,489 INFO [RS:1;jenkins-hbase4:38607] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/WALs/jenkins-hbase4.apache.org,38607,1676203405154/jenkins-hbase4.apache.org%2C38607%2C1676203405154.1676203406474 2023-02-12 12:03:26,489 DEBUG [RS:1;jenkins-hbase4:38607] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41685,DS-2e522bb4-c5bc-4bf0-9154-2d15ec18ff98,DISK], DatanodeInfoWithStorage[127.0.0.1:34603,DS-66074762-1f47-4cd2-9818-07cb2b718c5d,DISK]] 2023-02-12 12:03:26,492 INFO [jenkins-hbase4:42711] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:26,493 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bbd58b83fa40eafd5f50ca45cc57b456, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:26,493 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676203406493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203406493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203406493"}]},"ts":"1676203406493"} 2023-02-12 12:03:26,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure bbd58b83fa40eafd5f50ca45cc57b456, server=jenkins-hbase4.apache.org,38607,1676203405154}] 2023-02-12 12:03:26,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:26,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:26,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bbd58b83fa40eafd5f50ca45cc57b456, NAME => 'testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:26,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:26,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,651 INFO [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,653 DEBUG [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1 2023-02-12 12:03:26,653 DEBUG [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1 2023-02-12 12:03:26,653 INFO [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bbd58b83fa40eafd5f50ca45cc57b456 columnFamilyName f1 2023-02-12 12:03:26,653 INFO [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] regionserver.HStore(310): Store=bbd58b83fa40eafd5f50ca45cc57b456/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:26,654 INFO [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,654 DEBUG [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2 2023-02-12 12:03:26,654 DEBUG [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2 2023-02-12 12:03:26,655 INFO [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bbd58b83fa40eafd5f50ca45cc57b456 columnFamilyName f2 2023-02-12 12:03:26,655 INFO [StoreOpener-bbd58b83fa40eafd5f50ca45cc57b456-1] regionserver.HStore(310): Store=bbd58b83fa40eafd5f50ca45cc57b456/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:26,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:26,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:26,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:26,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bbd58b83fa40eafd5f50ca45cc57b456; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64982327, jitterRate=-0.03168787062168121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:26,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bbd58b83fa40eafd5f50ca45cc57b456: Running coprocessor pre-open hook at 1676203406650Writing region info on filesystem at 1676203406650Initializing all the Stores at 1676203406651 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203406651Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203406651Cleaning up temporary data from old regions at 1676203406656 (+5 ms)Cleaning up detritus from prior splits at 1676203406657 (+1 ms)Running coprocessor post-open hooks at 1676203406660 (+3 ms)Region opened successfully at 1676203406660 2023-02-12 12:03:26,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456., pid=12, masterSystemTime=1676203406646 2023-02-12 12:03:26,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:26,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:26,663 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bbd58b83fa40eafd5f50ca45cc57b456, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:26,663 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676203406663"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203406663"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203406663"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203406663"}]},"ts":"1676203406663"} 2023-02-12 12:03:26,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 12:03:26,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure bbd58b83fa40eafd5f50ca45cc57b456, server=jenkins-hbase4.apache.org,38607,1676203405154 in 170 msec 2023-02-12 12:03:26,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 12:03:26,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bbd58b83fa40eafd5f50ca45cc57b456, ASSIGN in 326 msec 2023-02-12 12:03:26,669 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:26,669 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203406669"}]},"ts":"1676203406669"} 2023-02-12 12:03:26,670 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-12 12:03:26,672 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:26,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 373 msec 2023-02-12 12:03:26,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:26,909 INFO [Listener at localhost/33679] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-12 12:03:26,909 DEBUG [Listener at localhost/33679] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-12 12:03:26,909 INFO [Listener at localhost/33679] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:26,911 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-12 12:03:26,911 INFO [Listener at localhost/33679] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:26,911 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-12 12:03:26,911 INFO [Listener at localhost/33679] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 12:03:26,957 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38607] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,060 INFO [Listener at localhost/33679] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 12:03:27,060 INFO [Listener at localhost/33679] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 12:03:27,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 12:03:27,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676203407062 (current time:1676203407062). 2023-02-12 12:03:27,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 12:03:27,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] zookeeper.ReadOnlyZKClient(139): Connect 0x5fedb5be to 127.0.0.1:49203 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:27,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2be2bb3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:27,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:27,071 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39722, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:27,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fedb5be to 127.0.0.1:49203 2023-02-12 12:03:27,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:27,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 12:03:27,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 12:03:27,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 12:03:27,077 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 12:03:27,078 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676204007078 2023-02-12 12:03:27,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 12:03:27,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,079 DEBUG [Listener at localhost/33679] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:27,079 DEBUG [Listener at localhost/33679] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 12:03:27,080 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 12:03:27,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 12:03:27,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-12 12:03:27,082 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 12:03:27,082 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676204007082 2023-02-12 12:03:27,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 12:03:27,092 INFO [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 12:03:27,092 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:27,096 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 12:03:27,096 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 12:03:27,097 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,097 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:27,098 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,098 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:27,098 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:27,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:27,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:27,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:27,099 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,099 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:27,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:27,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 12:03:27,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 12:03:27,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 12:03:27,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:27,100 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 12:03:27,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 12:03:27,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 12:03:27,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:27,100 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 12:03:27,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 12:03:27,100 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 12:03:27,101 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:27,101 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 12:03:27,101 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 12:03:27,101 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 12:03:27,101 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:27,101 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43541,1676203405119' joining acquired barrier for procedure (foo) in zk 2023-02-12 12:03:27,102 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 12:03:27,102 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 12:03:27,102 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38607,1676203405154' joining acquired barrier for procedure (foo) in zk 2023-02-12 12:03:27,104 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,106 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,106 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,106 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,106 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:27,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:27,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:27,106 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,106 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:27,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:27,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:27,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:27,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:27,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38607,1676203405154' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 12:03:27,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@957a249[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:27,109 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 12:03:27,109 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,111 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,111 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,112 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 12:03:27,112 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 12:03:27,112 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,112 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:27,112 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 12:03:27,112 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,43541,1676203405119' in zk 2023-02-12 12:03:27,114 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 12:03:27,114 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:27,114 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 12:03:27,116 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 12:03:27,117 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:27,117 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,117 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. started... 2023-02-12 12:03:27,118 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bbd58b83fa40eafd5f50ca45cc57b456 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 12:03:27,145 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/.tmp/f1/74a130be9a274932b1c50ed3a0477057 2023-02-12 12:03:27,167 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/.tmp/f2/b7cb86b7d961435680d6c39bf805726a 2023-02-12 12:03:27,172 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/.tmp/f1/74a130be9a274932b1c50ed3a0477057 as hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/74a130be9a274932b1c50ed3a0477057 2023-02-12 12:03:27,178 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/74a130be9a274932b1c50ed3a0477057, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 12:03:27,179 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/.tmp/f2/b7cb86b7d961435680d6c39bf805726a as hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/b7cb86b7d961435680d6c39bf805726a 2023-02-12 12:03:27,180 DEBUG [Listener at localhost/33679] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:27,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 12:03:27,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:27,182 DEBUG [Listener at localhost/33679] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 12:03:27,184 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/b7cb86b7d961435680d6c39bf805726a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 12:03:27,185 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for bbd58b83fa40eafd5f50ca45cc57b456 in 67ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:27,185 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 12:03:27,186 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bbd58b83fa40eafd5f50ca45cc57b456: 2023-02-12 12:03:27,186 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.' region-info for snapshot=foo 2023-02-12 12:03:27,186 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:27,186 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/74a130be9a274932b1c50ed3a0477057] hfiles 2023-02-12 12:03:27,186 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/74a130be9a274932b1c50ed3a0477057 for snapshot=foo 2023-02-12 12:03:27,186 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/b7cb86b7d961435680d6c39bf805726a] hfiles 2023-02-12 12:03:27,186 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/b7cb86b7d961435680d6c39bf805726a for snapshot=foo 2023-02-12 12:03:27,194 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. completed. 2023-02-12 12:03:27,194 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,194 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 12:03:27,194 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 12:03:27,194 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,194 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 12:03:27,194 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38607,1676203405154' in zk 2023-02-12 12:03:27,196 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 12:03:27,196 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,196 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:27,196 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 12:03:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,38607,1676203405154': 2023-02-12 12:03:27,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38607,1676203405154' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 12:03:27,200 INFO [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 12:03:27,200 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:27,200 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:27,200 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 12:03:27,200 INFO [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 12:03:27,206 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,206 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:27,206 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,206 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,206 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:27,207 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:27,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,207 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:27,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,209 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:27,209 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,215 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:27,215 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:27,215 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:27,215 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:27,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:27,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:27,215 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:27,215 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 12:03:27,215 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:27,215 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:27,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 12:03:27,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:27,215 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:27,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:27,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:27,217 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:27,217 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,217 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,217 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,217 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 12:03:27,217 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 12:03:27,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.hbase-snapshot/.tmp/foo 2023-02-12 12:03:27,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.hbase-snapshot/.tmp/foo to hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.hbase-snapshot/foo 2023-02-12 12:03:27,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-12 12:03:27,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.hbase-snapshot/.tmp/foo 2023-02-12 12:03:27,248 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.hbase-snapshot/.tmp/foo 2023-02-12 12:03:27,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676203407078Consolidate snapshot: foo at 1676203407215 (+137 ms)Loading Region manifests for foo at 1676203407217 (+2 ms)Writing data manifest for foo at 1676203407220 (+3 ms)Verifying snapshot: foo at 1676203407226 (+6 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676203407247 (+21 ms) 2023-02-12 12:03:27,249 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 12:03:27,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 171 msec 2023-02-12 12:03:27,382 DEBUG [Listener at localhost/33679] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:27,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 12:03:27,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 12:03:27,384 INFO [Listener at localhost/33679] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 12:03:27,388 INFO [Listener at localhost/33679] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 12:03:27,393 INFO [Listener at localhost/33679] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 12:03:27,430 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38607] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,522 INFO [Listener at localhost/33679] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 12:03:27,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 12:03:27,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,530 INFO [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-12 12:03:27,530 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:27,531 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-12 12:03:27,531 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-12 12:03:27,531 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,532 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,533 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:27,533 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:27,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:27,533 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:27,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:27,534 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,534 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:27,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:27,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:27,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,535 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,535 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,536 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,538 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 12:03:27,538 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 12:03:27,538 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:27,538 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:27,539 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 12:03:27,540 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 12:03:27,540 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 12:03:27,540 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43541,1676203405119' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 12:03:27,540 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 12:03:27,540 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:27,540 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,540 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. started... 2023-02-12 12:03:27,540 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bbd58b83fa40eafd5f50ca45cc57b456 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 12:03:27,542 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,543 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,543 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:27,564 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/.tmp/f1/4692a5d5405d4f97aeeeea45b5901302 2023-02-12 12:03:27,583 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/.tmp/f2/60d6b4164e924c6cadee7c4b2fd7fd4a 2023-02-12 12:03:27,587 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/.tmp/f1/4692a5d5405d4f97aeeeea45b5901302 as hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/4692a5d5405d4f97aeeeea45b5901302 2023-02-12 12:03:27,591 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/4692a5d5405d4f97aeeeea45b5901302, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 12:03:27,592 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/.tmp/f2/60d6b4164e924c6cadee7c4b2fd7fd4a as hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/60d6b4164e924c6cadee7c4b2fd7fd4a 2023-02-12 12:03:27,596 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/60d6b4164e924c6cadee7c4b2fd7fd4a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 12:03:27,597 INFO [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for bbd58b83fa40eafd5f50ca45cc57b456 in 57ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:27,598 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bbd58b83fa40eafd5f50ca45cc57b456: 2023-02-12 12:03:27,598 DEBUG [rs(jenkins-hbase4.apache.org,38607,1676203405154)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,598 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 12:03:27,598 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 12:03:27,598 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,598 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 12:03:27,598 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38607,1676203405154' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 12:03:27,599 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,599 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:27,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:27,600 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,600 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:27,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:27,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:27,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:27,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38607,1676203405154' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-12 12:03:27,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d6827bb[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:27,601 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-12 12:03:27,601 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,603 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,603 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 12:03:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 12:03:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 12:03:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 12:03:27,603 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,38607,1676203405154' in zk 2023-02-12 12:03:27,603 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,43541,1676203405119' in zk 2023-02-12 12:03:27,603 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:27,604 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 12:03:27,605 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:27,605 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,605 DEBUG [member: 'jenkins-hbase4.apache.org,38607,1676203405154' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 12:03:27,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 12:03:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:27,607 DEBUG [member: 'jenkins-hbase4.apache.org,43541,1676203405119' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 12:03:27,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,38607,1676203405154': 2023-02-12 12:03:27,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38607,1676203405154' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-12 12:03:27,610 INFO [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-12 12:03:27,610 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:27,610 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:27,610 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,610 INFO [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 12:03:27,611 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,611 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,611 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:27,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:27,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:27,611 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,611 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:27,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:27,612 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:27,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:27,612 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,614 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,614 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,616 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:27,616 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:27,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:27,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:27,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:27,616 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:27,616 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:27,616 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-12 12:03:27,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 12:03:27,617 DEBUG [(jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:27,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:27,617 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,618 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,618 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,618 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:27,618 DEBUG [Listener at localhost/33679] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:27,618 DEBUG [Listener at localhost/33679] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 12:03:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:27,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:27,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:27,618 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,618 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,618 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,618 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,718 DEBUG [Listener at localhost/33679] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 12:03:27,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 12:03:27,724 INFO [Listener at localhost/33679] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676203407062 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:27,724 DEBUG [Listener at localhost/33679] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40331/user/jenkins/test-data/38317be6-f6c2-e365-a330-acb781cf52b8/foo/861ef022-7f44-4cdc-891c-ab98e5707a23/data/default/testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,724 INFO [Listener at localhost/33679] snapshot.RestoreSnapshotHelper(239): region to add: bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:27,725 INFO [Listener at localhost/33679] snapshot.RestoreSnapshotHelper(585): clone region=bbd58b83fa40eafd5f50ca45cc57b456 as bbd58b83fa40eafd5f50ca45cc57b456 in snapshot foo 2023-02-12 12:03:27,725 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bbd58b83fa40eafd5f50ca45cc57b456, NAME => 'testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40331/user/jenkins/test-data/38317be6-f6c2-e365-a330-acb781cf52b8/foo/861ef022-7f44-4cdc-891c-ab98e5707a23 2023-02-12 12:03:27,734 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:27,735 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 74a130be9a274932b1c50ed3a0477057 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,737 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b7cb86b7d961435680d6c39bf805726a from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,739 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bbd58b83fa40eafd5f50ca45cc57b456, disabling compactions & flushes 2023-02-12 12:03:27,739 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,739 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,739 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. after waiting 0 ms 2023-02-12 12:03:27,739 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,739 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,739 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bbd58b83fa40eafd5f50ca45cc57b456: Waiting for close lock at 1676203407739Disabling compacts and flushes for region at 1676203407739Disabling writes for close at 1676203407739Writing region close event to WAL at 1676203407739Closed at 1676203407739 2023-02-12 12:03:27,739 INFO [Listener at localhost/33679] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676203407062 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:27,739 DEBUG [Listener at localhost/33679] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40331/user/jenkins/test-data/38317be6-f6c2-e365-a330-acb781cf52b8/foo/861ef022-7f44-4cdc-891c-ab98e5707a23 2023-02-12 12:03:27,740 DEBUG [Listener at localhost/33679] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40331/user/jenkins/test-data/38317be6-f6c2-e365-a330-acb781cf52b8/foo/861ef022-7f44-4cdc-891c-ab98e5707a23 2023-02-12 12:03:27,740 DEBUG [Listener at localhost/33679] util.CommonFSUtils(699): |-data/ 2023-02-12 12:03:27,741 DEBUG [Listener at localhost/33679] util.CommonFSUtils(699): |----default/ 2023-02-12 12:03:27,741 DEBUG [Listener at localhost/33679] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-12 12:03:27,741 DEBUG [Listener at localhost/33679] util.CommonFSUtils(699): |----------bbd58b83fa40eafd5f50ca45cc57b456/ 2023-02-12 12:03:27,742 DEBUG [Listener at localhost/33679] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:27,742 DEBUG [Listener at localhost/33679] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:27,742 DEBUG [Listener at localhost/33679] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=bbd58b83fa40eafd5f50ca45cc57b456-74a130be9a274932b1c50ed3a0477057 2023-02-12 12:03:27,742 DEBUG [Listener at localhost/33679] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:27,742 DEBUG [Listener at localhost/33679] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=bbd58b83fa40eafd5f50ca45cc57b456-b7cb86b7d961435680d6c39bf805726a 2023-02-12 12:03:27,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-12 12:03:27,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 12:03:27,746 INFO [Listener at localhost/33679] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:27,750 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203407750"}]},"ts":"1676203407750"} 2023-02-12 12:03:27,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:27,751 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-12 12:03:27,753 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-12 12:03:27,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bbd58b83fa40eafd5f50ca45cc57b456, UNASSIGN}] 2023-02-12 12:03:27,755 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bbd58b83fa40eafd5f50ca45cc57b456, UNASSIGN 2023-02-12 12:03:27,756 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bbd58b83fa40eafd5f50ca45cc57b456, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:27,756 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676203407756"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203407756"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203407756"}]},"ts":"1676203407756"} 2023-02-12 12:03:27,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure bbd58b83fa40eafd5f50ca45cc57b456, server=jenkins-hbase4.apache.org,38607,1676203405154}] 2023-02-12 12:03:27,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:27,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:27,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bbd58b83fa40eafd5f50ca45cc57b456, disabling compactions & flushes 2023-02-12 12:03:27,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. after waiting 0 ms 2023-02-12 12:03:27,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:27,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456. 2023-02-12 12:03:27,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bbd58b83fa40eafd5f50ca45cc57b456: Waiting for close lock at 1676203407909Running coprocessor pre-close hooks at 1676203407909Disabling compacts and flushes for region at 1676203407909Disabling writes for close at 1676203407909Writing region close event to WAL at 1676203407910 (+1 ms)Running coprocessor post-close hooks at 1676203407914 (+4 ms)Closed at 1676203407914 2023-02-12 12:03:27,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:27,916 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bbd58b83fa40eafd5f50ca45cc57b456, regionState=CLOSED 2023-02-12 12:03:27,916 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676203407916"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203407916"}]},"ts":"1676203407916"} 2023-02-12 12:03:27,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 12:03:27,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure bbd58b83fa40eafd5f50ca45cc57b456, server=jenkins-hbase4.apache.org,38607,1676203405154 in 160 msec 2023-02-12 12:03:27,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 12:03:27,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=bbd58b83fa40eafd5f50ca45cc57b456, UNASSIGN in 165 msec 2023-02-12 12:03:27,921 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203407920"}]},"ts":"1676203407920"} 2023-02-12 12:03:27,922 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-12 12:03:27,924 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-12 12:03:27,925 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-12 12:03:28,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:28,053 INFO [Listener at localhost/33679] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-12 12:03:28,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:28,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:28,056 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:28,057 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:28,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 12:03:28,060 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:28,062 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1, FileablePath, hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2, FileablePath, hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/recovered.edits] 2023-02-12 12:03:28,065 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/4692a5d5405d4f97aeeeea45b5901302 to hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/archive/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/4692a5d5405d4f97aeeeea45b5901302 2023-02-12 12:03:28,067 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/74a130be9a274932b1c50ed3a0477057 to hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/archive/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f1/74a130be9a274932b1c50ed3a0477057 2023-02-12 12:03:28,069 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/60d6b4164e924c6cadee7c4b2fd7fd4a to hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/archive/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/60d6b4164e924c6cadee7c4b2fd7fd4a 2023-02-12 12:03:28,070 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/b7cb86b7d961435680d6c39bf805726a to hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/archive/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/f2/b7cb86b7d961435680d6c39bf805726a 2023-02-12 12:03:28,073 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/recovered.edits/12.seqid to hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/archive/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456/recovered.edits/12.seqid 2023-02-12 12:03:28,073 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/.tmp/data/default/testInitTableSnapshotMapperJobConfig/bbd58b83fa40eafd5f50ca45cc57b456 2023-02-12 12:03:28,073 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 12:03:28,075 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:28,077 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-12 12:03:28,078 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-12 12:03:28,079 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:28,079 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-12 12:03:28,079 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203408079"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:28,080 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 12:03:28,081 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bbd58b83fa40eafd5f50ca45cc57b456, NAME => 'testInitTableSnapshotMapperJobConfig,,1676203406299.bbd58b83fa40eafd5f50ca45cc57b456.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 12:03:28,081 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-12 12:03:28,081 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676203408081"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:28,084 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-12 12:03:28,086 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 12:03:28,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 32 msec 2023-02-12 12:03:28,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 12:03:28,159 INFO [Listener at localhost/33679] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-12 12:03:28,159 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 12:03:28,159 INFO [Listener at localhost/33679] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 12:03:28,159 DEBUG [Listener at localhost/33679] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44113cd6 to 127.0.0.1:49203 2023-02-12 12:03:28,159 DEBUG [Listener at localhost/33679] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:28,159 DEBUG [Listener at localhost/33679] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 12:03:28,159 DEBUG [Listener at localhost/33679] util.JVMClusterUtil(257): Found active master hash=1624967760, stopped=false 2023-02-12 12:03:28,160 INFO [Listener at localhost/33679] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:28,162 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:28,162 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:28,162 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:28,162 INFO [Listener at localhost/33679] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 12:03:28,162 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:28,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:28,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:28,164 DEBUG [Listener at localhost/33679] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76a6cd2c to 127.0.0.1:49203 2023-02-12 12:03:28,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:28,165 DEBUG [Listener at localhost/33679] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:28,165 INFO [Listener at localhost/33679] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43541,1676203405119' ***** 2023-02-12 12:03:28,165 INFO [Listener at localhost/33679] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:28,165 INFO [Listener at localhost/33679] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38607,1676203405154' ***** 2023-02-12 12:03:28,165 INFO [Listener at localhost/33679] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:28,165 INFO [RS:1;jenkins-hbase4:38607] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:28,165 INFO [RS:0;jenkins-hbase4:43541] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:28,165 INFO [RS:1;jenkins-hbase4:38607] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:28,166 INFO [RS:1;jenkins-hbase4:38607] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:28,166 INFO [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:28,166 DEBUG [RS:1;jenkins-hbase4:38607] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41c4b98f to 127.0.0.1:49203 2023-02-12 12:03:28,166 DEBUG [RS:1;jenkins-hbase4:38607] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:28,166 INFO [RS:1;jenkins-hbase4:38607] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:28,166 INFO [RS:1;jenkins-hbase4:38607] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:28,166 INFO [RS:1;jenkins-hbase4:38607] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:28,166 INFO [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 12:03:28,165 INFO [RS:0;jenkins-hbase4:43541] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:28,165 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:28,166 INFO [RS:0;jenkins-hbase4:43541] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:28,167 INFO [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(3304): Received CLOSE for a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:28,165 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:28,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:28,168 INFO [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:28,169 DEBUG [RS:0;jenkins-hbase4:43541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a4f1f20 to 127.0.0.1:49203 2023-02-12 12:03:28,169 DEBUG [RS:0;jenkins-hbase4:43541] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:28,169 INFO [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 12:03:28,169 DEBUG [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1479): Online Regions={a7e695b43eeadb3d24115dfc624f0394=hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394.} 2023-02-12 12:03:28,169 DEBUG [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1505): Waiting on a7e695b43eeadb3d24115dfc624f0394 2023-02-12 12:03:28,166 INFO [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 12:03:28,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:28,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a7e695b43eeadb3d24115dfc624f0394, disabling compactions & flushes 2023-02-12 12:03:28,170 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:28,169 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 12:03:28,170 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:28,170 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:28,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:28,170 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:28,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:28,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. after waiting 0 ms 2023-02-12 12:03:28,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:28,170 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-12 12:03:28,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a7e695b43eeadb3d24115dfc624f0394 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 12:03:28,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394/.tmp/info/263c45f8cbcf49b3809a18151bf65793 2023-02-12 12:03:28,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394/.tmp/info/263c45f8cbcf49b3809a18151bf65793 as hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394/info/263c45f8cbcf49b3809a18151bf65793 2023-02-12 12:03:28,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394/info/263c45f8cbcf49b3809a18151bf65793, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 12:03:28,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a7e695b43eeadb3d24115dfc624f0394 in 30ms, sequenceid=6, compaction requested=false 2023-02-12 12:03:28,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 12:03:28,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/namespace/a7e695b43eeadb3d24115dfc624f0394/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 12:03:28,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:28,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a7e695b43eeadb3d24115dfc624f0394: Waiting for close lock at 1676203408168Running coprocessor pre-close hooks at 1676203408168Disabling compacts and flushes for region at 1676203408168Disabling writes for close at 1676203408170 (+2 ms)Obtaining lock to block concurrent updates at 1676203408170Preparing flush snapshotting stores in a7e695b43eeadb3d24115dfc624f0394 at 1676203408170Finished memstore snapshotting hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676203408170Flushing stores of hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. at 1676203408171 (+1 ms)Flushing a7e695b43eeadb3d24115dfc624f0394/info: creating writer at 1676203408171Flushing a7e695b43eeadb3d24115dfc624f0394/info: appending metadata at 1676203408177 (+6 ms)Flushing a7e695b43eeadb3d24115dfc624f0394/info: closing flushed file at 1676203408177Flushing a7e695b43eeadb3d24115dfc624f0394/info: reopening flushed file at 1676203408196 (+19 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a7e695b43eeadb3d24115dfc624f0394 in 30ms, sequenceid=6, compaction requested=false at 1676203408200 (+4 ms)Writing region close event to WAL at 1676203408201 (+1 ms)Running coprocessor post-close hooks at 1676203408204 (+3 ms)Closed at 1676203408204 2023-02-12 12:03:28,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676203405831.a7e695b43eeadb3d24115dfc624f0394. 2023-02-12 12:03:28,238 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:28,239 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:28,369 INFO [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43541,1676203405119; all regions closed. 2023-02-12 12:03:28,370 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:28,374 DEBUG [RS:0;jenkins-hbase4:43541] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/oldWALs 2023-02-12 12:03:28,374 INFO [RS:0;jenkins-hbase4:43541] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43541%2C1676203405119:(num 1676203406188) 2023-02-12 12:03:28,374 DEBUG [RS:0;jenkins-hbase4:43541] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:28,375 INFO [RS:0;jenkins-hbase4:43541] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:28,375 INFO [RS:0;jenkins-hbase4:43541] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:28,375 INFO [RS:0;jenkins-hbase4:43541] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:28,375 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:28,375 INFO [RS:0;jenkins-hbase4:43541] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:28,375 INFO [RS:0;jenkins-hbase4:43541] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:28,376 INFO [RS:0;jenkins-hbase4:43541] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43541 2023-02-12 12:03:28,377 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:28,377 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:28,377 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:28,377 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43541,1676203405119 2023-02-12 12:03:28,378 ERROR [Listener at localhost/33679-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cc3ec33 rejected from java.util.concurrent.ThreadPoolExecutor@38fc6f73[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:28,378 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:28,378 ERROR [Listener at localhost/33679-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6f48d1a8 rejected from java.util.concurrent.ThreadPoolExecutor@38fc6f73[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:28,380 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43541,1676203405119] 2023-02-12 12:03:28,380 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43541,1676203405119; numProcessing=1 2023-02-12 12:03:28,381 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43541,1676203405119 already deleted, retry=false 2023-02-12 12:03:28,381 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43541,1676203405119 expired; onlineServers=1 2023-02-12 12:03:28,505 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 12:03:28,505 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 12:03:28,570 DEBUG [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:28,591 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/.tmp/info/d820457313aa4e3ca4f4001da9c226af 2023-02-12 12:03:28,596 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d820457313aa4e3ca4f4001da9c226af 2023-02-12 12:03:28,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/.tmp/rep_barrier/6e8b2cdac0c84d9b93f440faee303569 2023-02-12 12:03:28,610 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e8b2cdac0c84d9b93f440faee303569 2023-02-12 12:03:28,621 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/.tmp/table/61ce189a108249be8e640e8bf374a2d7 2023-02-12 12:03:28,626 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61ce189a108249be8e640e8bf374a2d7 2023-02-12 12:03:28,627 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/.tmp/info/d820457313aa4e3ca4f4001da9c226af as hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/info/d820457313aa4e3ca4f4001da9c226af 2023-02-12 12:03:28,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d820457313aa4e3ca4f4001da9c226af 2023-02-12 12:03:28,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/info/d820457313aa4e3ca4f4001da9c226af, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 12:03:28,632 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/.tmp/rep_barrier/6e8b2cdac0c84d9b93f440faee303569 as hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/rep_barrier/6e8b2cdac0c84d9b93f440faee303569 2023-02-12 12:03:28,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e8b2cdac0c84d9b93f440faee303569 2023-02-12 12:03:28,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/rep_barrier/6e8b2cdac0c84d9b93f440faee303569, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 12:03:28,637 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/.tmp/table/61ce189a108249be8e640e8bf374a2d7 as hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/table/61ce189a108249be8e640e8bf374a2d7 2023-02-12 12:03:28,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61ce189a108249be8e640e8bf374a2d7 2023-02-12 12:03:28,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/table/61ce189a108249be8e640e8bf374a2d7, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 12:03:28,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 472ms, sequenceid=21, compaction requested=false 2023-02-12 12:03:28,642 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 12:03:28,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 12:03:28,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:28,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:28,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203408167Running coprocessor pre-close hooks at 1676203408167Disabling compacts and flushes for region at 1676203408167Disabling writes for close at 1676203408170 (+3 ms)Obtaining lock to block concurrent updates at 1676203408170Preparing flush snapshotting stores in 1588230740 at 1676203408170Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676203408170Flushing stores of hbase:meta,,1.1588230740 at 1676203408171 (+1 ms)Flushing 1588230740/info: creating writer at 1676203408171Flushing 1588230740/info: appending metadata at 1676203408177 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676203408177Flushing 1588230740/rep_barrier: creating writer at 1676203408596 (+419 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676203408598 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676203408598Flushing 1588230740/table: creating writer at 1676203408610 (+12 ms)Flushing 1588230740/table: appending metadata at 1676203408612 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676203408612Flushing 1588230740/info: reopening flushed file at 1676203408627 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676203408632 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676203408638 (+6 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 472ms, sequenceid=21, compaction requested=false at 1676203408642 (+4 ms)Writing region close event to WAL at 1676203408648 (+6 ms)Running coprocessor post-close hooks at 1676203408651 (+3 ms)Closed at 1676203408651 2023-02-12 12:03:28,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:28,662 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:28,662 INFO [RS:0;jenkins-hbase4:43541] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43541,1676203405119; zookeeper connection closed. 2023-02-12 12:03:28,662 ERROR [Listener at localhost/33679-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1795731b rejected from java.util.concurrent.ThreadPoolExecutor@38fc6f73[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:28,663 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:43541-0x100486a18c40001, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:28,663 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@609aa537] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@609aa537 2023-02-12 12:03:28,663 ERROR [Listener at localhost/33679-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34bd5ec4 rejected from java.util.concurrent.ThreadPoolExecutor@38fc6f73[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:28,770 INFO [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38607,1676203405154; all regions closed. 2023-02-12 12:03:28,775 DEBUG [RS:1;jenkins-hbase4:38607] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/oldWALs 2023-02-12 12:03:28,776 INFO [RS:1;jenkins-hbase4:38607] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38607%2C1676203405154.meta:.meta(num 1676203405751) 2023-02-12 12:03:28,780 DEBUG [RS:1;jenkins-hbase4:38607] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/oldWALs 2023-02-12 12:03:28,780 INFO [RS:1;jenkins-hbase4:38607] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38607%2C1676203405154:(num 1676203406474) 2023-02-12 12:03:28,780 DEBUG [RS:1;jenkins-hbase4:38607] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:28,780 INFO [RS:1;jenkins-hbase4:38607] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:28,780 INFO [RS:1;jenkins-hbase4:38607] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:28,781 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:28,781 INFO [RS:1;jenkins-hbase4:38607] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38607 2023-02-12 12:03:28,783 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:28,783 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38607,1676203405154 2023-02-12 12:03:28,783 ERROR [Listener at localhost/33679-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50311283 rejected from java.util.concurrent.ThreadPoolExecutor@540e8c5d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:28,783 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38607,1676203405154] 2023-02-12 12:03:28,784 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38607,1676203405154; numProcessing=2 2023-02-12 12:03:28,787 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38607,1676203405154 already deleted, retry=false 2023-02-12 12:03:28,787 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38607,1676203405154 expired; onlineServers=0 2023-02-12 12:03:28,787 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42711,1676203405073' ***** 2023-02-12 12:03:28,787 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 12:03:28,787 DEBUG [M:0;jenkins-hbase4:42711] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64e48293, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:28,787 INFO [M:0;jenkins-hbase4:42711] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42711,1676203405073 2023-02-12 12:03:28,787 INFO [M:0;jenkins-hbase4:42711] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42711,1676203405073; all regions closed. 2023-02-12 12:03:28,787 DEBUG [M:0;jenkins-hbase4:42711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:28,788 DEBUG [M:0;jenkins-hbase4:42711] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 12:03:28,788 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 12:03:28,788 DEBUG [M:0;jenkins-hbase4:42711] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 12:03:28,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203405352] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203405352,5,FailOnTimeoutGroup] 2023-02-12 12:03:28,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203405357] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203405357,5,FailOnTimeoutGroup] 2023-02-12 12:03:28,788 INFO [M:0;jenkins-hbase4:42711] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 12:03:28,789 INFO [M:0;jenkins-hbase4:42711] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 12:03:28,789 INFO [M:0;jenkins-hbase4:42711] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 12:03:28,789 DEBUG [M:0;jenkins-hbase4:42711] master.HMaster(1502): Stopping service threads 2023-02-12 12:03:28,789 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:28,789 INFO [M:0;jenkins-hbase4:42711] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 12:03:28,789 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:28,790 ERROR [M:0;jenkins-hbase4:42711] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 12:03:28,790 INFO [M:0;jenkins-hbase4:42711] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 12:03:28,790 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 12:03:28,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:28,790 DEBUG [M:0;jenkins-hbase4:42711] zookeeper.ZKUtil(398): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 12:03:28,790 WARN [M:0;jenkins-hbase4:42711] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 12:03:28,790 INFO [M:0;jenkins-hbase4:42711] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 12:03:28,791 INFO [M:0;jenkins-hbase4:42711] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 12:03:28,791 DEBUG [M:0;jenkins-hbase4:42711] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:28,791 INFO [M:0;jenkins-hbase4:42711] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:28,791 DEBUG [M:0;jenkins-hbase4:42711] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:28,791 DEBUG [M:0;jenkins-hbase4:42711] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:28,791 DEBUG [M:0;jenkins-hbase4:42711] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:28,792 INFO [M:0;jenkins-hbase4:42711] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.88 KB heapSize=66.81 KB 2023-02-12 12:03:28,800 INFO [M:0;jenkins-hbase4:42711] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.88 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cc0c7dca59904e5d9f1edc0aa5df1f28 2023-02-12 12:03:28,804 DEBUG [M:0;jenkins-hbase4:42711] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cc0c7dca59904e5d9f1edc0aa5df1f28 as hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cc0c7dca59904e5d9f1edc0aa5df1f28 2023-02-12 12:03:28,807 INFO [M:0;jenkins-hbase4:42711] regionserver.HStore(1080): Added hdfs://localhost:40331/user/jenkins/test-data/f8139e8b-aa82-f63b-8e21-e7cad3d368ba/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cc0c7dca59904e5d9f1edc0aa5df1f28, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 12:03:28,808 INFO [M:0;jenkins-hbase4:42711] regionserver.HRegion(2947): Finished flush of dataSize ~55.88 KB/57220, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-12 12:03:28,808 INFO [M:0;jenkins-hbase4:42711] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:28,808 DEBUG [M:0;jenkins-hbase4:42711] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203408791Disabling compacts and flushes for region at 1676203408791Disabling writes for close at 1676203408791Obtaining lock to block concurrent updates at 1676203408792 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676203408792Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57220, getHeapSize=68400, getOffHeapSize=0, getCellsCount=145 at 1676203408792Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676203408792Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676203408793 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676203408795 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676203408795Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676203408804 (+9 ms)Finished flush of dataSize ~55.88 KB/57220, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676203408808 (+4 ms)Writing region close event to WAL at 1676203408808Closed at 1676203408808 2023-02-12 12:03:28,811 INFO [M:0;jenkins-hbase4:42711] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 12:03:28,811 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:28,812 INFO [M:0;jenkins-hbase4:42711] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42711 2023-02-12 12:03:28,813 DEBUG [M:0;jenkins-hbase4:42711] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42711,1676203405073 already deleted, retry=false 2023-02-12 12:03:28,885 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:28,885 INFO [RS:1;jenkins-hbase4:38607] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38607,1676203405154; zookeeper connection closed. 2023-02-12 12:03:28,885 ERROR [Listener at localhost/33679-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@782a4a3b rejected from java.util.concurrent.ThreadPoolExecutor@540e8c5d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:28,885 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): regionserver:38607-0x100486a18c40002, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:28,885 ERROR [Listener at localhost/33679-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1be694 rejected from java.util.concurrent.ThreadPoolExecutor@540e8c5d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:28,885 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@a65daf7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@a65daf7 2023-02-12 12:03:28,885 INFO [Listener at localhost/33679] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 12:03:28,985 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:28,985 INFO [M:0;jenkins-hbase4:42711] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42711,1676203405073; zookeeper connection closed. 2023-02-12 12:03:28,985 ERROR [Listener at localhost/33679-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ff56e05 rejected from java.util.concurrent.ThreadPoolExecutor@2bcaef23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:28,986 DEBUG [Listener at localhost/33679-EventThread] zookeeper.ZKWatcher(600): master:42711-0x100486a18c40000, quorum=127.0.0.1:49203, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:28,986 ERROR [Listener at localhost/33679-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5bed65a8 rejected from java.util.concurrent.ThreadPoolExecutor@2bcaef23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:28,986 WARN [Listener at localhost/33679] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:28,990 INFO [Listener at localhost/33679] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:29,096 WARN [BP-45479535-172.31.14.131-1676203404507 heartbeating to localhost/127.0.0.1:40331] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:29,097 WARN [BP-45479535-172.31.14.131-1676203404507 heartbeating to localhost/127.0.0.1:40331] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-45479535-172.31.14.131-1676203404507 (Datanode Uuid dc714616-d2a5-4f36-b3a9-736796fd0633) service to localhost/127.0.0.1:40331 2023-02-12 12:03:29,097 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/cluster_b9026805-dd4d-4bd1-3b44-fa93ddf1e5c5/dfs/data/data3/current/BP-45479535-172.31.14.131-1676203404507] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:29,097 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/cluster_b9026805-dd4d-4bd1-3b44-fa93ddf1e5c5/dfs/data/data4/current/BP-45479535-172.31.14.131-1676203404507] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:29,099 WARN [Listener at localhost/33679] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:29,102 INFO [Listener at localhost/33679] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:29,206 WARN [BP-45479535-172.31.14.131-1676203404507 heartbeating to localhost/127.0.0.1:40331] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:29,206 WARN [BP-45479535-172.31.14.131-1676203404507 heartbeating to localhost/127.0.0.1:40331] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-45479535-172.31.14.131-1676203404507 (Datanode Uuid daa01354-b935-4d80-ba7e-db6834013482) service to localhost/127.0.0.1:40331 2023-02-12 12:03:29,206 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/cluster_b9026805-dd4d-4bd1-3b44-fa93ddf1e5c5/dfs/data/data1/current/BP-45479535-172.31.14.131-1676203404507] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:29,207 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/cluster_b9026805-dd4d-4bd1-3b44-fa93ddf1e5c5/dfs/data/data2/current/BP-45479535-172.31.14.131-1676203404507] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:29,219 INFO [Listener at localhost/33679] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:29,337 INFO [Listener at localhost/33679] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 12:03:29,357 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 12:03:29,369 INFO [Listener at localhost/33679] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=179 (was 155) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:40331 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40331 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40331 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40331 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33679 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42711,1676203405073)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:40331 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40331 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40331 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=570 (was 537) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=332 (was 343), ProcessCount=166 (was 166), AvailableMemoryMB=4118 (was 4213) 2023-02-12 12:03:29,378 INFO [Listener at localhost/33679] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=179, OpenFileDescriptor=570, MaxFileDescriptor=60000, SystemLoadAverage=332, ProcessCount=166, AvailableMemoryMB=4118 2023-02-12 12:03:29,389 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/hadoop.log.dir so I do NOT create it in target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a 2023-02-12 12:03:29,389 WARN [Listener at localhost/33679] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 12:03:29,389 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/hadoop.tmp.dir so I do NOT create it in target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a 2023-02-12 12:03:29,389 WARN [Listener at localhost/33679] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9650c269-1045-63cb-f336-be3c2d69f8c1/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 12:03:29,389 DEBUG [Listener at localhost/33679] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a 2023-02-12 12:03:29,389 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 12:03:29,389 INFO [Listener at localhost/33679] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/cluster_651cb6e7-e9aa-d523-2acc-c778996bc62e, deleteOnExit=true 2023-02-12 12:03:29,389 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 12:03:29,389 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/test.cache.data in system properties and HBase conf 2023-02-12 12:03:29,389 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 12:03:29,390 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/hadoop.log.dir in system properties and HBase conf 2023-02-12 12:03:29,390 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 12:03:29,390 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 12:03:29,390 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 12:03:29,390 DEBUG [Listener at localhost/33679] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 12:03:29,390 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:29,390 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:29,390 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 12:03:29,390 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/nfs.dump.dir in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/java.io.tmpdir in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 12:03:29,391 INFO [Listener at localhost/33679] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 12:03:29,395 WARN [Listener at localhost/33679] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:29,395 WARN [Listener at localhost/33679] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:29,441 WARN [Listener at localhost/33679] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:29,443 INFO [Listener at localhost/33679] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:29,447 INFO [Listener at localhost/33679] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/java.io.tmpdir/Jetty_localhost_45431_hdfs____.w97l5x/webapp 2023-02-12 12:03:29,541 INFO [Listener at localhost/33679] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45431 2023-02-12 12:03:29,546 WARN [Listener at localhost/33679] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:29,546 WARN [Listener at localhost/33679] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:29,594 WARN [Listener at localhost/38993] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:29,606 WARN [Listener at localhost/38993] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:29,608 WARN [Listener at localhost/38993] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:29,610 INFO [Listener at localhost/38993] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:29,616 INFO [Listener at localhost/38993] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/java.io.tmpdir/Jetty_localhost_34793_datanode____.tbrn9l/webapp 2023-02-12 12:03:29,708 INFO [Listener at localhost/38993] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34793 2023-02-12 12:03:29,714 WARN [Listener at localhost/35765] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:29,730 WARN [Listener at localhost/35765] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:29,732 WARN [Listener at localhost/35765] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:29,734 INFO [Listener at localhost/35765] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:29,738 INFO [Listener at localhost/35765] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/java.io.tmpdir/Jetty_localhost_37385_datanode____.do0ryl/webapp 2023-02-12 12:03:29,806 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11170ab8b2e2f1ac: Processing first storage report for DS-bdad644a-3734-4b2b-8faf-f8a1261c507d from datanode 52c039fb-6cf6-4ce5-aec9-68ee6407a20a 2023-02-12 12:03:29,806 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11170ab8b2e2f1ac: from storage DS-bdad644a-3734-4b2b-8faf-f8a1261c507d node DatanodeRegistration(127.0.0.1:36231, datanodeUuid=52c039fb-6cf6-4ce5-aec9-68ee6407a20a, infoPort=43779, infoSecurePort=0, ipcPort=35765, storageInfo=lv=-57;cid=testClusterID;nsid=1950717628;c=1676203409398), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:29,806 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x11170ab8b2e2f1ac: Processing first storage report for DS-83923c0c-db40-4496-90cc-762850f7a98a from datanode 52c039fb-6cf6-4ce5-aec9-68ee6407a20a 2023-02-12 12:03:29,806 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x11170ab8b2e2f1ac: from storage DS-83923c0c-db40-4496-90cc-762850f7a98a node DatanodeRegistration(127.0.0.1:36231, datanodeUuid=52c039fb-6cf6-4ce5-aec9-68ee6407a20a, infoPort=43779, infoSecurePort=0, ipcPort=35765, storageInfo=lv=-57;cid=testClusterID;nsid=1950717628;c=1676203409398), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:29,839 INFO [Listener at localhost/35765] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37385 2023-02-12 12:03:29,847 WARN [Listener at localhost/37189] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:29,954 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63dbfcff146608b: Processing first storage report for DS-16c84599-3546-4795-91a9-35ebfad3c0c9 from datanode 3acec884-f981-4a01-86ad-98c945e6ace9 2023-02-12 12:03:29,954 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63dbfcff146608b: from storage DS-16c84599-3546-4795-91a9-35ebfad3c0c9 node DatanodeRegistration(127.0.0.1:39075, datanodeUuid=3acec884-f981-4a01-86ad-98c945e6ace9, infoPort=44373, infoSecurePort=0, ipcPort=37189, storageInfo=lv=-57;cid=testClusterID;nsid=1950717628;c=1676203409398), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:29,954 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63dbfcff146608b: Processing first storage report for DS-eceff7f4-a8fe-43b6-8c86-f486978712f9 from datanode 3acec884-f981-4a01-86ad-98c945e6ace9 2023-02-12 12:03:29,954 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63dbfcff146608b: from storage DS-eceff7f4-a8fe-43b6-8c86-f486978712f9 node DatanodeRegistration(127.0.0.1:39075, datanodeUuid=3acec884-f981-4a01-86ad-98c945e6ace9, infoPort=44373, infoSecurePort=0, ipcPort=37189, storageInfo=lv=-57;cid=testClusterID;nsid=1950717628;c=1676203409398), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:30,055 DEBUG [Listener at localhost/37189] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a 2023-02-12 12:03:30,057 INFO [Listener at localhost/37189] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/cluster_651cb6e7-e9aa-d523-2acc-c778996bc62e/zookeeper_0, clientPort=62383, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/cluster_651cb6e7-e9aa-d523-2acc-c778996bc62e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/cluster_651cb6e7-e9aa-d523-2acc-c778996bc62e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 12:03:30,058 INFO [Listener at localhost/37189] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62383 2023-02-12 12:03:30,058 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,059 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,072 INFO [Listener at localhost/37189] util.FSUtils(479): Created version file at hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0 with version=8 2023-02-12 12:03:30,073 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,073 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,074 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/hbase-staging 2023-02-12 12:03:30,076 INFO [Listener at localhost/37189] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:30,076 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:30,076 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:30,076 INFO [Listener at localhost/37189] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:30,076 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:30,076 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:30,076 INFO [Listener at localhost/37189] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:30,077 INFO [Listener at localhost/37189] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40569 2023-02-12 12:03:30,078 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,079 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,080 INFO [Listener at localhost/37189] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40569 connecting to ZooKeeper ensemble=127.0.0.1:62383 2023-02-12 12:03:30,087 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:405690x0, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:30,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40569-0x100486a2c4d0000 connected 2023-02-12 12:03:30,101 DEBUG [Listener at localhost/37189] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:30,102 DEBUG [Listener at localhost/37189] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:30,102 DEBUG [Listener at localhost/37189] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:30,104 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40569 2023-02-12 12:03:30,108 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40569 2023-02-12 12:03:30,108 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40569 2023-02-12 12:03:30,108 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40569 2023-02-12 12:03:30,109 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40569 2023-02-12 12:03:30,110 INFO [Listener at localhost/37189] master.HMaster(439): hbase.rootdir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0, hbase.cluster.distributed=false 2023-02-12 12:03:30,122 INFO [Listener at localhost/37189] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:30,122 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:30,122 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:30,122 INFO [Listener at localhost/37189] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:30,122 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:30,122 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:30,122 INFO [Listener at localhost/37189] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:30,123 INFO [Listener at localhost/37189] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38457 2023-02-12 12:03:30,123 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:30,125 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:30,125 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,127 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,128 INFO [Listener at localhost/37189] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38457 connecting to ZooKeeper ensemble=127.0.0.1:62383 2023-02-12 12:03:30,132 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:384570x0, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:30,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38457-0x100486a2c4d0001 connected 2023-02-12 12:03:30,133 DEBUG [Listener at localhost/37189] zookeeper.ZKUtil(164): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:30,134 DEBUG [Listener at localhost/37189] zookeeper.ZKUtil(164): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:30,134 DEBUG [Listener at localhost/37189] zookeeper.ZKUtil(164): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:30,136 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38457 2023-02-12 12:03:30,136 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38457 2023-02-12 12:03:30,137 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38457 2023-02-12 12:03:30,140 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38457 2023-02-12 12:03:30,140 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38457 2023-02-12 12:03:30,151 INFO [Listener at localhost/37189] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:30,151 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:30,151 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:30,151 INFO [Listener at localhost/37189] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:30,151 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:30,151 INFO [Listener at localhost/37189] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:30,151 INFO [Listener at localhost/37189] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:30,152 INFO [Listener at localhost/37189] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44631 2023-02-12 12:03:30,153 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:30,154 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:30,154 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,155 INFO [Listener at localhost/37189] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,157 INFO [Listener at localhost/37189] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44631 connecting to ZooKeeper ensemble=127.0.0.1:62383 2023-02-12 12:03:30,160 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:446310x0, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:30,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44631-0x100486a2c4d0002 connected 2023-02-12 12:03:30,162 DEBUG [Listener at localhost/37189] zookeeper.ZKUtil(164): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:30,162 DEBUG [Listener at localhost/37189] zookeeper.ZKUtil(164): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:30,163 DEBUG [Listener at localhost/37189] zookeeper.ZKUtil(164): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:30,164 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44631 2023-02-12 12:03:30,164 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44631 2023-02-12 12:03:30,166 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44631 2023-02-12 12:03:30,167 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44631 2023-02-12 12:03:30,167 DEBUG [Listener at localhost/37189] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44631 2023-02-12 12:03:30,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:30,169 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:30,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:30,171 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:30,171 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:30,171 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:30,171 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:30,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:30,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:30,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40569,1676203410076 from backup master directory 2023-02-12 12:03:30,174 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:30,174 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:30,174 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:30,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:30,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/hbase.id with ID: 59ec4efe-e5c9-4ef0-ab94-19ab74a1f9fa 2023-02-12 12:03:30,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:30,203 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:30,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0e0f3d23 to 127.0.0.1:62383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:30,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56106a1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:30,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:30,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 12:03:30,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:30,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/data/master/store-tmp 2023-02-12 12:03:30,471 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:30,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:30,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:30,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:30,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:30,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:30,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:30,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:30,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203410625Disabling compacts and flushes for region at 1676203410625Disabling writes for close at 1676203410626 (+1 ms)Writing region close event to WAL at 1676203410626Closed at 1676203410626 2023-02-12 12:03:30,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/WALs/jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:30,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40569%2C1676203410076, suffix=, logDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/WALs/jenkins-hbase4.apache.org,40569,1676203410076, archiveDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/oldWALs, maxLogs=10 2023-02-12 12:03:30,648 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36231,DS-bdad644a-3734-4b2b-8faf-f8a1261c507d,DISK] 2023-02-12 12:03:30,648 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39075,DS-16c84599-3546-4795-91a9-35ebfad3c0c9,DISK] 2023-02-12 12:03:30,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/WALs/jenkins-hbase4.apache.org,40569,1676203410076/jenkins-hbase4.apache.org%2C40569%2C1676203410076.1676203410629 2023-02-12 12:03:30,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36231,DS-bdad644a-3734-4b2b-8faf-f8a1261c507d,DISK], DatanodeInfoWithStorage[127.0.0.1:39075,DS-16c84599-3546-4795-91a9-35ebfad3c0c9,DISK]] 2023-02-12 12:03:30,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:30,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:30,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:30,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:30,657 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:30,658 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 12:03:30,659 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 12:03:30,659 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:30,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:30,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:30,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:30,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:30,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69777185, jitterRate=0.03976108133792877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:30,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676203410652Initializing all the Stores at 1676203410653 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203410653Cleaning up temporary data from old regions at 1676203410661 (+8 ms)Cleaning up detritus from prior splits at 1676203410661Region opened successfully at 1676203410669 (+8 ms) 2023-02-12 12:03:30,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 12:03:30,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 12:03:30,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 12:03:30,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 12:03:30,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 12:03:30,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 12:03:30,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 12:03:30,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 12:03:30,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 12:03:30,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 12:03:30,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 12:03:30,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 12:03:30,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 12:03:30,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 12:03:30,691 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:30,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 12:03:30,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 12:03:30,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 12:03:30,693 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:30,693 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:30,694 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:30,694 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:30,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40569,1676203410076, sessionid=0x100486a2c4d0000, setting cluster-up flag (Was=false) 2023-02-12 12:03:30,704 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:30,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 12:03:30,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:30,712 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:30,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 12:03:30,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:30,717 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.hbase-snapshot/.tmp 2023-02-12 12:03:30,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:30,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:30,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:30,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:30,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:30,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 12:03:30,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:30,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676203440721 2023-02-12 12:03:30,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 12:03:30,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 12:03:30,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 12:03:30,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 12:03:30,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 12:03:30,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 12:03:30,721 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:30,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,721 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 12:03:30,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 12:03:30,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 12:03:30,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 12:03:30,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 12:03:30,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 12:03:30,723 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:30,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203410723,5,FailOnTimeoutGroup] 2023-02-12 12:03:30,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203410724,5,FailOnTimeoutGroup] 2023-02-12 12:03:30,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 12:03:30,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,736 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:30,737 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:30,737 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0 2023-02-12 12:03:30,744 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:30,745 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:30,746 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/info 2023-02-12 12:03:30,747 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:30,747 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:30,747 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:30,748 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:30,748 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:30,749 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:30,749 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:30,750 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/table 2023-02-12 12:03:30,750 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:30,750 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:30,751 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740 2023-02-12 12:03:30,751 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740 2023-02-12 12:03:30,753 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:30,754 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:30,755 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:30,756 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75175641, jitterRate=0.12020434439182281}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:30,756 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676203410744Initializing all the Stores at 1676203410745 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203410745Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203410745Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203410745Cleaning up temporary data from old regions at 1676203410752 (+7 ms)Cleaning up detritus from prior splits at 1676203410752Region opened successfully at 1676203410756 (+4 ms) 2023-02-12 12:03:30,756 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:30,756 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:30,756 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:30,756 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:30,756 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:30,756 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:30,756 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203410756Disabling compacts and flushes for region at 1676203410756Disabling writes for close at 1676203410756Writing region close event to WAL at 1676203410756Closed at 1676203410756 2023-02-12 12:03:30,757 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:30,757 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 12:03:30,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 12:03:30,759 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 12:03:30,760 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 12:03:30,769 INFO [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(952): ClusterId : 59ec4efe-e5c9-4ef0-ab94-19ab74a1f9fa 2023-02-12 12:03:30,769 INFO [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(952): ClusterId : 59ec4efe-e5c9-4ef0-ab94-19ab74a1f9fa 2023-02-12 12:03:30,769 DEBUG [RS:0;jenkins-hbase4:38457] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:30,769 DEBUG [RS:1;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:30,771 DEBUG [RS:1;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:30,771 DEBUG [RS:1;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:30,771 DEBUG [RS:0;jenkins-hbase4:38457] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:30,771 DEBUG [RS:0;jenkins-hbase4:38457] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:30,774 DEBUG [RS:1;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:30,775 DEBUG [RS:0;jenkins-hbase4:38457] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:30,776 DEBUG [RS:1;jenkins-hbase4:44631] zookeeper.ReadOnlyZKClient(139): Connect 0x0981b851 to 127.0.0.1:62383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:30,776 DEBUG [RS:0;jenkins-hbase4:38457] zookeeper.ReadOnlyZKClient(139): Connect 0x288a9412 to 127.0.0.1:62383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:30,781 DEBUG [RS:1;jenkins-hbase4:44631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7465711, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:30,781 DEBUG [RS:0;jenkins-hbase4:38457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@264d6f73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:30,781 DEBUG [RS:1;jenkins-hbase4:44631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@379d321, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:30,781 DEBUG [RS:0;jenkins-hbase4:38457] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2272ff62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:30,789 DEBUG [RS:0;jenkins-hbase4:38457] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38457 2023-02-12 12:03:30,789 INFO [RS:0;jenkins-hbase4:38457] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:30,789 INFO [RS:0;jenkins-hbase4:38457] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:30,789 DEBUG [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:30,790 INFO [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40569,1676203410076 with isa=jenkins-hbase4.apache.org/172.31.14.131:38457, startcode=1676203410122 2023-02-12 12:03:30,790 DEBUG [RS:0;jenkins-hbase4:38457] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:30,792 DEBUG [RS:1;jenkins-hbase4:44631] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44631 2023-02-12 12:03:30,792 INFO [RS:1;jenkins-hbase4:44631] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:30,792 INFO [RS:1;jenkins-hbase4:44631] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:30,792 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53275, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:30,792 DEBUG [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:30,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:30,794 INFO [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40569,1676203410076 with isa=jenkins-hbase4.apache.org/172.31.14.131:44631, startcode=1676203410150 2023-02-12 12:03:30,794 DEBUG [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0 2023-02-12 12:03:30,794 DEBUG [RS:1;jenkins-hbase4:44631] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:30,794 DEBUG [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38993 2023-02-12 12:03:30,794 DEBUG [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:30,796 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34521, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:30,796 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:30,796 DEBUG [RS:0;jenkins-hbase4:38457] zookeeper.ZKUtil(162): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:30,796 WARN [RS:0;jenkins-hbase4:38457] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:30,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:30,797 INFO [RS:0;jenkins-hbase4:38457] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:30,797 DEBUG [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/WALs/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:30,797 DEBUG [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0 2023-02-12 12:03:30,797 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38457,1676203410122] 2023-02-12 12:03:30,797 DEBUG [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38993 2023-02-12 12:03:30,797 DEBUG [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:30,803 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:30,803 DEBUG [RS:1;jenkins-hbase4:44631] zookeeper.ZKUtil(162): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:30,803 WARN [RS:1;jenkins-hbase4:44631] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:30,803 INFO [RS:1;jenkins-hbase4:44631] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:30,803 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44631,1676203410150] 2023-02-12 12:03:30,803 DEBUG [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/WALs/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:30,803 DEBUG [RS:0;jenkins-hbase4:38457] zookeeper.ZKUtil(162): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:30,804 DEBUG [RS:0;jenkins-hbase4:38457] zookeeper.ZKUtil(162): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:30,806 DEBUG [RS:0;jenkins-hbase4:38457] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:30,806 INFO [RS:0;jenkins-hbase4:38457] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:30,807 DEBUG [RS:1;jenkins-hbase4:44631] zookeeper.ZKUtil(162): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:30,807 DEBUG [RS:1;jenkins-hbase4:44631] zookeeper.ZKUtil(162): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:30,808 INFO [RS:0;jenkins-hbase4:38457] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:30,808 DEBUG [RS:1;jenkins-hbase4:44631] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:30,808 INFO [RS:0;jenkins-hbase4:38457] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:30,808 INFO [RS:0;jenkins-hbase4:38457] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,808 INFO [RS:1;jenkins-hbase4:44631] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:30,808 INFO [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:30,810 INFO [RS:0;jenkins-hbase4:38457] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,810 INFO [RS:1;jenkins-hbase4:44631] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:30,810 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,810 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,810 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,810 INFO [RS:1;jenkins-hbase4:44631] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:30,810 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,810 INFO [RS:1;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,810 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,810 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:30,810 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,810 INFO [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:30,810 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,811 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,811 DEBUG [RS:0;jenkins-hbase4:38457] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,812 INFO [RS:0;jenkins-hbase4:38457] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,812 INFO [RS:0;jenkins-hbase4:38457] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,812 INFO [RS:0;jenkins-hbase4:38457] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,812 INFO [RS:1;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,813 DEBUG [RS:1;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:30,816 INFO [RS:1;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,816 INFO [RS:1;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,817 INFO [RS:1;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,825 INFO [RS:0;jenkins-hbase4:38457] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:30,825 INFO [RS:0;jenkins-hbase4:38457] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38457,1676203410122-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,831 INFO [RS:1;jenkins-hbase4:44631] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:30,831 INFO [RS:1;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44631,1676203410150-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:30,835 INFO [RS:0;jenkins-hbase4:38457] regionserver.Replication(203): jenkins-hbase4.apache.org,38457,1676203410122 started 2023-02-12 12:03:30,835 INFO [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38457,1676203410122, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38457, sessionid=0x100486a2c4d0001 2023-02-12 12:03:30,835 DEBUG [RS:0;jenkins-hbase4:38457] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:30,835 DEBUG [RS:0;jenkins-hbase4:38457] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:30,835 DEBUG [RS:0;jenkins-hbase4:38457] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38457,1676203410122' 2023-02-12 12:03:30,835 DEBUG [RS:0;jenkins-hbase4:38457] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:30,835 DEBUG [RS:0;jenkins-hbase4:38457] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:30,836 DEBUG [RS:0;jenkins-hbase4:38457] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:30,836 DEBUG [RS:0;jenkins-hbase4:38457] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:30,836 DEBUG [RS:0;jenkins-hbase4:38457] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:30,836 DEBUG [RS:0;jenkins-hbase4:38457] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38457,1676203410122' 2023-02-12 12:03:30,836 DEBUG [RS:0;jenkins-hbase4:38457] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:30,836 DEBUG [RS:0;jenkins-hbase4:38457] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:30,836 DEBUG [RS:0;jenkins-hbase4:38457] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:30,836 INFO [RS:0;jenkins-hbase4:38457] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:30,836 INFO [RS:0;jenkins-hbase4:38457] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:30,841 INFO [RS:1;jenkins-hbase4:44631] regionserver.Replication(203): jenkins-hbase4.apache.org,44631,1676203410150 started 2023-02-12 12:03:30,841 INFO [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44631,1676203410150, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44631, sessionid=0x100486a2c4d0002 2023-02-12 12:03:30,841 DEBUG [RS:1;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:30,841 DEBUG [RS:1;jenkins-hbase4:44631] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:30,841 DEBUG [RS:1;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44631,1676203410150' 2023-02-12 12:03:30,841 DEBUG [RS:1;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:30,841 DEBUG [RS:1;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:30,841 DEBUG [RS:1;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:30,841 DEBUG [RS:1;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:30,842 DEBUG [RS:1;jenkins-hbase4:44631] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:30,842 DEBUG [RS:1;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44631,1676203410150' 2023-02-12 12:03:30,842 DEBUG [RS:1;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:30,842 DEBUG [RS:1;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:30,842 DEBUG [RS:1;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:30,842 INFO [RS:1;jenkins-hbase4:44631] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:30,842 INFO [RS:1;jenkins-hbase4:44631] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:30,910 DEBUG [jenkins-hbase4:40569] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 12:03:30,910 DEBUG [jenkins-hbase4:40569] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:30,912 DEBUG [jenkins-hbase4:40569] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:30,912 DEBUG [jenkins-hbase4:40569] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:30,912 DEBUG [jenkins-hbase4:40569] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:30,913 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38457,1676203410122, state=OPENING 2023-02-12 12:03:30,915 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 12:03:30,916 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:30,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:30,917 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:31,096 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:31,096 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:31,116 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50216, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:31,120 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 12:03:31,121 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:31,122 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38457%2C1676203410122.meta, suffix=.meta, logDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/WALs/jenkins-hbase4.apache.org,38457,1676203410122, archiveDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/oldWALs, maxLogs=32 2023-02-12 12:03:31,136 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39075,DS-16c84599-3546-4795-91a9-35ebfad3c0c9,DISK] 2023-02-12 12:03:31,137 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36231,DS-bdad644a-3734-4b2b-8faf-f8a1261c507d,DISK] 2023-02-12 12:03:31,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/WALs/jenkins-hbase4.apache.org,38457,1676203410122/jenkins-hbase4.apache.org%2C38457%2C1676203410122.meta.1676203411123.meta 2023-02-12 12:03:31,139 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39075,DS-16c84599-3546-4795-91a9-35ebfad3c0c9,DISK], DatanodeInfoWithStorage[127.0.0.1:36231,DS-bdad644a-3734-4b2b-8faf-f8a1261c507d,DISK]] 2023-02-12 12:03:31,139 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:31,139 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 12:03:31,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 12:03:31,140 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 12:03:31,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 12:03:31,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 12:03:31,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 12:03:31,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:31,142 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/info 2023-02-12 12:03:31,142 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/info 2023-02-12 12:03:31,143 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:31,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:31,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:31,144 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:31,144 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:31,144 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:31,145 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:31,145 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:31,146 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/table 2023-02-12 12:03:31,146 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/table 2023-02-12 12:03:31,146 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:31,147 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:31,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740 2023-02-12 12:03:31,148 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740 2023-02-12 12:03:31,150 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:31,151 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:31,152 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69445148, jitterRate=0.03481334447860718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:31,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676203411140Writing region info on filesystem at 1676203411140Initializing all the Stores at 1676203411141 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203411141Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203411141Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203411141Cleaning up temporary data from old regions at 1676203411149 (+8 ms)Cleaning up detritus from prior splits at 1676203411150 (+1 ms)Running coprocessor post-open hooks at 1676203411152 (+2 ms)Region opened successfully at 1676203411152 2023-02-12 12:03:31,153 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676203411096 2023-02-12 12:03:31,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 12:03:31,158 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 12:03:31,158 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38457,1676203410122, state=OPEN 2023-02-12 12:03:31,160 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 12:03:31,160 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:31,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 12:03:31,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38457,1676203410122 in 243 msec 2023-02-12 12:03:31,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 12:03:31,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 404 msec 2023-02-12 12:03:31,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 445 msec 2023-02-12 12:03:31,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676203410170, completionTime=-1 2023-02-12 12:03:31,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 12:03:31,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 12:03:31,168 DEBUG [hconnection-0x3cceb606-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:31,169 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50220, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:31,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 12:03:31,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676203471171 2023-02-12 12:03:31,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676203531171 2023-02-12 12:03:31,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-12 12:03:31,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40569,1676203410076-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:31,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40569,1676203410076-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:31,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40569,1676203410076-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:31,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40569, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:31,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:31,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 12:03:31,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:31,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 12:03:31,179 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 12:03:31,179 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:31,180 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:31,181 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/hbase/namespace/3165655d51baaffe01181da74487af25 2023-02-12 12:03:31,182 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/hbase/namespace/3165655d51baaffe01181da74487af25 empty. 2023-02-12 12:03:31,182 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/hbase/namespace/3165655d51baaffe01181da74487af25 2023-02-12 12:03:31,183 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 12:03:31,196 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:31,198 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3165655d51baaffe01181da74487af25, NAME => 'hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,206 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,206 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3165655d51baaffe01181da74487af25, disabling compactions & flushes 2023-02-12 12:03:31,206 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:31,206 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:31,207 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. after waiting 0 ms 2023-02-12 12:03:31,207 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:31,207 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:31,207 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3165655d51baaffe01181da74487af25: Waiting for close lock at 1676203411206Disabling compacts and flushes for region at 1676203411206Disabling writes for close at 1676203411207 (+1 ms)Writing region close event to WAL at 1676203411207Closed at 1676203411207 2023-02-12 12:03:31,209 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:31,210 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203411210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411210"}]},"ts":"1676203411210"} 2023-02-12 12:03:31,213 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:31,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:31,214 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203411214"}]},"ts":"1676203411214"} 2023-02-12 12:03:31,215 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 12:03:31,219 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:31,219 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:31,219 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:31,219 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:31,221 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3165655d51baaffe01181da74487af25, ASSIGN}] 2023-02-12 12:03:31,223 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3165655d51baaffe01181da74487af25, ASSIGN 2023-02-12 12:03:31,224 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3165655d51baaffe01181da74487af25, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676203410150; forceNewPlan=false, retain=false 2023-02-12 12:03:31,295 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 12:03:31,374 INFO [jenkins-hbase4:40569] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:31,375 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3165655d51baaffe01181da74487af25, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:31,375 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203411375"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203411375"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203411375"}]},"ts":"1676203411375"} 2023-02-12 12:03:31,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3165655d51baaffe01181da74487af25, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:31,529 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:31,529 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:31,531 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46994, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:31,536 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:31,538 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44631%2C1676203410150, suffix=, logDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/WALs/jenkins-hbase4.apache.org,44631,1676203410150, archiveDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/oldWALs, maxLogs=32 2023-02-12 12:03:31,554 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39075,DS-16c84599-3546-4795-91a9-35ebfad3c0c9,DISK] 2023-02-12 12:03:31,554 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36231,DS-bdad644a-3734-4b2b-8faf-f8a1261c507d,DISK] 2023-02-12 12:03:31,563 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/WALs/jenkins-hbase4.apache.org,44631,1676203410150/jenkins-hbase4.apache.org%2C44631%2C1676203410150.1676203411538 2023-02-12 12:03:31,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39075,DS-16c84599-3546-4795-91a9-35ebfad3c0c9,DISK], DatanodeInfoWithStorage[127.0.0.1:36231,DS-bdad644a-3734-4b2b-8faf-f8a1261c507d,DISK]] 2023-02-12 12:03:31,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3165655d51baaffe01181da74487af25, NAME => 'hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:31,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3165655d51baaffe01181da74487af25 2023-02-12 12:03:31,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3165655d51baaffe01181da74487af25 2023-02-12 12:03:31,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3165655d51baaffe01181da74487af25 2023-02-12 12:03:31,567 INFO [StoreOpener-3165655d51baaffe01181da74487af25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3165655d51baaffe01181da74487af25 2023-02-12 12:03:31,568 DEBUG [StoreOpener-3165655d51baaffe01181da74487af25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25/info 2023-02-12 12:03:31,569 DEBUG [StoreOpener-3165655d51baaffe01181da74487af25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25/info 2023-02-12 12:03:31,569 INFO [StoreOpener-3165655d51baaffe01181da74487af25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3165655d51baaffe01181da74487af25 columnFamilyName info 2023-02-12 12:03:31,569 INFO [StoreOpener-3165655d51baaffe01181da74487af25-1] regionserver.HStore(310): Store=3165655d51baaffe01181da74487af25/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:31,570 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25 2023-02-12 12:03:31,570 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25 2023-02-12 12:03:31,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3165655d51baaffe01181da74487af25 2023-02-12 12:03:31,575 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:31,575 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3165655d51baaffe01181da74487af25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66689222, jitterRate=-0.006253153085708618}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:31,575 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3165655d51baaffe01181da74487af25: Running coprocessor pre-open hook at 1676203411564Writing region info on filesystem at 1676203411564Initializing all the Stores at 1676203411565 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203411565Cleaning up temporary data from old regions at 1676203411571 (+6 ms)Cleaning up detritus from prior splits at 1676203411571Running coprocessor post-open hooks at 1676203411575 (+4 ms)Region opened successfully at 1676203411575 2023-02-12 12:03:31,576 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25., pid=6, masterSystemTime=1676203411529 2023-02-12 12:03:31,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:31,581 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:31,582 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3165655d51baaffe01181da74487af25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:31,582 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203411582"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203411582"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203411582"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203411582"}]},"ts":"1676203411582"} 2023-02-12 12:03:31,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 12:03:31,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3165655d51baaffe01181da74487af25, server=jenkins-hbase4.apache.org,44631,1676203410150 in 206 msec 2023-02-12 12:03:31,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 12:03:31,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3165655d51baaffe01181da74487af25, ASSIGN in 364 msec 2023-02-12 12:03:31,586 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:31,587 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203411586"}]},"ts":"1676203411586"} 2023-02-12 12:03:31,588 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 12:03:31,591 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:31,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 413 msec 2023-02-12 12:03:31,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 12:03:31,682 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:31,682 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:31,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:31,686 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:31,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 12:03:31,697 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:31,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-12 12:03:31,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 12:03:31,717 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:31,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-12 12:03:31,734 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 12:03:31,738 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 12:03:31,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.564sec 2023-02-12 12:03:31,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 12:03:31,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 12:03:31,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 12:03:31,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40569,1676203410076-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 12:03:31,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40569,1676203410076-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 12:03:31,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 12:03:31,781 DEBUG [Listener at localhost/37189] zookeeper.ReadOnlyZKClient(139): Connect 0x6a8375cd to 127.0.0.1:62383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:31,786 DEBUG [Listener at localhost/37189] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ab71b16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:31,788 DEBUG [hconnection-0x7b745d22-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:31,790 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50228, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:31,791 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:31,791 DEBUG [Listener at localhost/37189] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 12:03:31,793 DEBUG [Listener at localhost/37189] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 12:03:31,795 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32830, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 12:03:31,795 INFO [Listener at localhost/37189] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 12:03:31,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-12 12:03:31,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 12:03:31,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:32830 deadline: 1676203471796, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-12 12:03:31,797 INFO [Listener at localhost/37189] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-12 12:03:31,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:31,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:31,802 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:31,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-12 12:03:31,802 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:31,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:31,810 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af 2023-02-12 12:03:31,810 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:31,810 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:31,810 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:31,810 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275 2023-02-12 12:03:31,810 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:31,810 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:31,810 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:31,811 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af empty. 2023-02-12 12:03:31,811 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca empty. 2023-02-12 12:03:31,811 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf empty. 2023-02-12 12:03:31,811 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b empty. 2023-02-12 12:03:31,811 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b empty. 2023-02-12 12:03:31,811 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275 empty. 2023-02-12 12:03:31,811 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759 empty. 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164 empty. 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:31,812 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6 empty. 2023-02-12 12:03:31,813 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275 2023-02-12 12:03:31,813 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe empty. 2023-02-12 12:03:31,813 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:31,813 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:31,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 12:03:31,822 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:31,824 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1741f347554acb33c94d7a04a06b5759, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,824 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 08d929761de87e16486cc6686e3347af, NAME => 'testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,824 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 848a3a18cbe98cc320d08ba07b8ba96b, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,838 INFO [RS:0;jenkins-hbase4:38457] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38457%2C1676203410122, suffix=, logDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/WALs/jenkins-hbase4.apache.org,38457,1676203410122, archiveDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/oldWALs, maxLogs=32 2023-02-12 12:03:31,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,843 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 1741f347554acb33c94d7a04a06b5759, disabling compactions & flushes 2023-02-12 12:03:31,844 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:31,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:31,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. after waiting 0 ms 2023-02-12 12:03:31,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:31,844 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:31,844 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 1741f347554acb33c94d7a04a06b5759: Waiting for close lock at 1676203411843Disabling compacts and flushes for region at 1676203411843Disabling writes for close at 1676203411844 (+1 ms)Writing region close event to WAL at 1676203411844Closed at 1676203411844 2023-02-12 12:03:31,844 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2c10d8776c481f0b5ffdcfbe99a6d164, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,845 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,845 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 08d929761de87e16486cc6686e3347af, disabling compactions & flushes 2023-02-12 12:03:31,845 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:31,845 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:31,845 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. after waiting 0 ms 2023-02-12 12:03:31,845 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:31,845 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:31,845 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 08d929761de87e16486cc6686e3347af: Waiting for close lock at 1676203411845Disabling compacts and flushes for region at 1676203411845Disabling writes for close at 1676203411845Writing region close event to WAL at 1676203411845Closed at 1676203411845 2023-02-12 12:03:31,846 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2c3130a9983348c23f864030241d7275, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,856 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,856 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 848a3a18cbe98cc320d08ba07b8ba96b, disabling compactions & flushes 2023-02-12 12:03:31,856 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39075,DS-16c84599-3546-4795-91a9-35ebfad3c0c9,DISK] 2023-02-12 12:03:31,856 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36231,DS-bdad644a-3734-4b2b-8faf-f8a1261c507d,DISK] 2023-02-12 12:03:31,856 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:31,856 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:31,856 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. after waiting 0 ms 2023-02-12 12:03:31,856 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:31,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:31,857 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 848a3a18cbe98cc320d08ba07b8ba96b: Waiting for close lock at 1676203411856Disabling compacts and flushes for region at 1676203411856Disabling writes for close at 1676203411856Writing region close event to WAL at 1676203411857 (+1 ms)Closed at 1676203411857 2023-02-12 12:03:31,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 351ecbb77474c77ceb24de58cb2ad7ca, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,863 INFO [RS:0;jenkins-hbase4:38457] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/WALs/jenkins-hbase4.apache.org,38457,1676203410122/jenkins-hbase4.apache.org%2C38457%2C1676203410122.1676203411838 2023-02-12 12:03:31,864 DEBUG [RS:0;jenkins-hbase4:38457] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39075,DS-16c84599-3546-4795-91a9-35ebfad3c0c9,DISK], DatanodeInfoWithStorage[127.0.0.1:36231,DS-bdad644a-3734-4b2b-8faf-f8a1261c507d,DISK]] 2023-02-12 12:03:31,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 2c3130a9983348c23f864030241d7275, disabling compactions & flushes 2023-02-12 12:03:31,869 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:31,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:31,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. after waiting 0 ms 2023-02-12 12:03:31,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:31,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,869 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:31,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 2c10d8776c481f0b5ffdcfbe99a6d164, disabling compactions & flushes 2023-02-12 12:03:31,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 2c3130a9983348c23f864030241d7275: Waiting for close lock at 1676203411869Disabling compacts and flushes for region at 1676203411869Disabling writes for close at 1676203411869Writing region close event to WAL at 1676203411869Closed at 1676203411869 2023-02-12 12:03:31,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:31,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:31,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. after waiting 0 ms 2023-02-12 12:03:31,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:31,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6e2e3201329af15e3eef03df24f2bddf, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:31,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 2c10d8776c481f0b5ffdcfbe99a6d164: Waiting for close lock at 1676203411870Disabling compacts and flushes for region at 1676203411870Disabling writes for close at 1676203411870Writing region close event to WAL at 1676203411870Closed at 1676203411870 2023-02-12 12:03:31,871 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 2ee046517bff49ca9065bc171bb2e44b, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 351ecbb77474c77ceb24de58cb2ad7ca, disabling compactions & flushes 2023-02-12 12:03:31,873 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:31,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:31,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. after waiting 0 ms 2023-02-12 12:03:31,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:31,873 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:31,873 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 351ecbb77474c77ceb24de58cb2ad7ca: Waiting for close lock at 1676203411873Disabling compacts and flushes for region at 1676203411873Disabling writes for close at 1676203411873Writing region close event to WAL at 1676203411873Closed at 1676203411873 2023-02-12 12:03:31,874 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0b4accc0c33226ffa7fd5dc4aa27cdc6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 6e2e3201329af15e3eef03df24f2bddf, disabling compactions & flushes 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 2ee046517bff49ca9065bc171bb2e44b, disabling compactions & flushes 2023-02-12 12:03:31,881 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:31,881 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. after waiting 0 ms 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:31,881 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. after waiting 0 ms 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 6e2e3201329af15e3eef03df24f2bddf: Waiting for close lock at 1676203411881Disabling compacts and flushes for region at 1676203411881Disabling writes for close at 1676203411881Writing region close event to WAL at 1676203411881Closed at 1676203411881 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:31,881 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:31,881 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 2ee046517bff49ca9065bc171bb2e44b: Waiting for close lock at 1676203411881Disabling compacts and flushes for region at 1676203411881Disabling writes for close at 1676203411881Writing region close event to WAL at 1676203411881Closed at 1676203411881 2023-02-12 12:03:31,882 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8ae2df7fdfcc94c13f03c30905c97afe, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp 2023-02-12 12:03:31,884 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,884 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 0b4accc0c33226ffa7fd5dc4aa27cdc6, disabling compactions & flushes 2023-02-12 12:03:31,884 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:31,884 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:31,884 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. after waiting 0 ms 2023-02-12 12:03:31,884 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:31,884 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:31,884 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 0b4accc0c33226ffa7fd5dc4aa27cdc6: Waiting for close lock at 1676203411884Disabling compacts and flushes for region at 1676203411884Disabling writes for close at 1676203411884Writing region close event to WAL at 1676203411884Closed at 1676203411884 2023-02-12 12:03:31,887 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:31,887 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 8ae2df7fdfcc94c13f03c30905c97afe, disabling compactions & flushes 2023-02-12 12:03:31,887 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:31,887 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:31,887 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. after waiting 0 ms 2023-02-12 12:03:31,888 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:31,888 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:31,888 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 8ae2df7fdfcc94c13f03c30905c97afe: Waiting for close lock at 1676203411887Disabling compacts and flushes for region at 1676203411887Disabling writes for close at 1676203411888 (+1 ms)Writing region close event to WAL at 1676203411888Closed at 1676203411888 2023-02-12 12:03:31,889 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:31,890 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,890 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,890 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,890 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676203411798.2c3130a9983348c23f864030241d7275.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203411890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203411890"}]},"ts":"1676203411890"} 2023-02-12 12:03:31,893 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 12:03:31,893 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:31,894 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203411893"}]},"ts":"1676203411893"} 2023-02-12 12:03:31,895 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-12 12:03:31,898 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:31,904 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:31,904 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:31,904 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:31,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08d929761de87e16486cc6686e3347af, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1741f347554acb33c94d7a04a06b5759, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=848a3a18cbe98cc320d08ba07b8ba96b, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c10d8776c481f0b5ffdcfbe99a6d164, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c3130a9983348c23f864030241d7275, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=351ecbb77474c77ceb24de58cb2ad7ca, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e2e3201329af15e3eef03df24f2bddf, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ee046517bff49ca9065bc171bb2e44b, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b4accc0c33226ffa7fd5dc4aa27cdc6, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ae2df7fdfcc94c13f03c30905c97afe, ASSIGN}] 2023-02-12 12:03:31,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:31,908 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c10d8776c481f0b5ffdcfbe99a6d164, ASSIGN 2023-02-12 12:03:31,908 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08d929761de87e16486cc6686e3347af, ASSIGN 2023-02-12 12:03:31,908 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1741f347554acb33c94d7a04a06b5759, ASSIGN 2023-02-12 12:03:31,909 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=848a3a18cbe98cc320d08ba07b8ba96b, ASSIGN 2023-02-12 12:03:31,909 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c10d8776c481f0b5ffdcfbe99a6d164, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676203410150; forceNewPlan=false, retain=false 2023-02-12 12:03:31,909 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08d929761de87e16486cc6686e3347af, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38457,1676203410122; forceNewPlan=false, retain=false 2023-02-12 12:03:31,909 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1741f347554acb33c94d7a04a06b5759, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676203410150; forceNewPlan=false, retain=false 2023-02-12 12:03:31,909 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=848a3a18cbe98cc320d08ba07b8ba96b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676203410150; forceNewPlan=false, retain=false 2023-02-12 12:03:31,910 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ae2df7fdfcc94c13f03c30905c97afe, ASSIGN 2023-02-12 12:03:31,910 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b4accc0c33226ffa7fd5dc4aa27cdc6, ASSIGN 2023-02-12 12:03:31,910 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ee046517bff49ca9065bc171bb2e44b, ASSIGN 2023-02-12 12:03:31,910 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e2e3201329af15e3eef03df24f2bddf, ASSIGN 2023-02-12 12:03:31,911 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=351ecbb77474c77ceb24de58cb2ad7ca, ASSIGN 2023-02-12 12:03:31,911 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ae2df7fdfcc94c13f03c30905c97afe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38457,1676203410122; forceNewPlan=false, retain=false 2023-02-12 12:03:31,911 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b4accc0c33226ffa7fd5dc4aa27cdc6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676203410150; forceNewPlan=false, retain=false 2023-02-12 12:03:31,911 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ee046517bff49ca9065bc171bb2e44b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38457,1676203410122; forceNewPlan=false, retain=false 2023-02-12 12:03:31,912 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e2e3201329af15e3eef03df24f2bddf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676203410150; forceNewPlan=false, retain=false 2023-02-12 12:03:31,912 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=351ecbb77474c77ceb24de58cb2ad7ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38457,1676203410122; forceNewPlan=false, retain=false 2023-02-12 12:03:31,912 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c3130a9983348c23f864030241d7275, ASSIGN 2023-02-12 12:03:31,913 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c3130a9983348c23f864030241d7275, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38457,1676203410122; forceNewPlan=false, retain=false 2023-02-12 12:03:32,059 INFO [jenkins-hbase4:40569] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 12:03:32,066 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6e2e3201329af15e3eef03df24f2bddf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,066 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0b4accc0c33226ffa7fd5dc4aa27cdc6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,066 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1741f347554acb33c94d7a04a06b5759, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,066 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=848a3a18cbe98cc320d08ba07b8ba96b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,066 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2c10d8776c481f0b5ffdcfbe99a6d164, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,067 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412066"}]},"ts":"1676203412066"} 2023-02-12 12:03:32,067 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412066"}]},"ts":"1676203412066"} 2023-02-12 12:03:32,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412066"}]},"ts":"1676203412066"} 2023-02-12 12:03:32,066 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412066"}]},"ts":"1676203412066"} 2023-02-12 12:03:32,066 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412066"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412066"}]},"ts":"1676203412066"} 2023-02-12 12:03:32,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=13, state=RUNNABLE; OpenRegionProcedure 848a3a18cbe98cc320d08ba07b8ba96b, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:32,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure 2c10d8776c481f0b5ffdcfbe99a6d164, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:32,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 1741f347554acb33c94d7a04a06b5759, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:32,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure 0b4accc0c33226ffa7fd5dc4aa27cdc6, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:32,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 6e2e3201329af15e3eef03df24f2bddf, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:32,071 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=351ecbb77474c77ceb24de58cb2ad7ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,071 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412071"}]},"ts":"1676203412071"} 2023-02-12 12:03:32,072 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8ae2df7fdfcc94c13f03c30905c97afe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,072 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203412072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412072"}]},"ts":"1676203412072"} 2023-02-12 12:03:32,073 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=08d929761de87e16486cc6686e3347af, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,073 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203412073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412073"}]},"ts":"1676203412073"} 2023-02-12 12:03:32,073 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=2ee046517bff49ca9065bc171bb2e44b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,074 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412073"}]},"ts":"1676203412073"} 2023-02-12 12:03:32,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=16, state=RUNNABLE; OpenRegionProcedure 351ecbb77474c77ceb24de58cb2ad7ca, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:32,075 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2c3130a9983348c23f864030241d7275, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,075 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676203411798.2c3130a9983348c23f864030241d7275.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203412075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203412075"}]},"ts":"1676203412075"} 2023-02-12 12:03:32,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 8ae2df7fdfcc94c13f03c30905c97afe, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:32,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=11, state=RUNNABLE; OpenRegionProcedure 08d929761de87e16486cc6686e3347af, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:32,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 2ee046517bff49ca9065bc171bb2e44b, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:32,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 2c3130a9983348c23f864030241d7275, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:32,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:32,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:32,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 848a3a18cbe98cc320d08ba07b8ba96b, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 12:03:32,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:32,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:32,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:32,225 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:32,226 DEBUG [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1 2023-02-12 12:03:32,226 DEBUG [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1 2023-02-12 12:03:32,227 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 848a3a18cbe98cc320d08ba07b8ba96b columnFamilyName f1 2023-02-12 12:03:32,227 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(310): Store=848a3a18cbe98cc320d08ba07b8ba96b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,227 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:32,229 DEBUG [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2 2023-02-12 12:03:32,229 DEBUG [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2 2023-02-12 12:03:32,229 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 848a3a18cbe98cc320d08ba07b8ba96b columnFamilyName f2 2023-02-12 12:03:32,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:32,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08d929761de87e16486cc6686e3347af, NAME => 'testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 12:03:32,230 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(310): Store=848a3a18cbe98cc320d08ba07b8ba96b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:32,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:32,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:32,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:32,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:32,231 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:32,232 DEBUG [StoreOpener-08d929761de87e16486cc6686e3347af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/f1 2023-02-12 12:03:32,232 DEBUG [StoreOpener-08d929761de87e16486cc6686e3347af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/f1 2023-02-12 12:03:32,233 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08d929761de87e16486cc6686e3347af columnFamilyName f1 2023-02-12 12:03:32,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,233 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] regionserver.HStore(310): Store=08d929761de87e16486cc6686e3347af/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,233 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:32,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:32,234 DEBUG [StoreOpener-08d929761de87e16486cc6686e3347af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/f2 2023-02-12 12:03:32,234 DEBUG [StoreOpener-08d929761de87e16486cc6686e3347af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/f2 2023-02-12 12:03:32,234 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08d929761de87e16486cc6686e3347af columnFamilyName f2 2023-02-12 12:03:32,235 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] regionserver.HStore(310): Store=08d929761de87e16486cc6686e3347af/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af 2023-02-12 12:03:32,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af 2023-02-12 12:03:32,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 848a3a18cbe98cc320d08ba07b8ba96b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61128713, jitterRate=-0.08911119401454926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 848a3a18cbe98cc320d08ba07b8ba96b: Running coprocessor pre-open hook at 1676203412224Writing region info on filesystem at 1676203412224Initializing all the Stores at 1676203412225 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412225Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412225Cleaning up temporary data from old regions at 1676203412231 (+6 ms)Cleaning up detritus from prior splits at 1676203412232 (+1 ms)Running coprocessor post-open hooks at 1676203412236 (+4 ms)Region opened successfully at 1676203412236 2023-02-12 12:03:32,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b., pid=21, masterSystemTime=1676203412220 2023-02-12 12:03:32,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:32,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:32,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:32,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0b4accc0c33226ffa7fd5dc4aa27cdc6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 12:03:32,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:32,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:32,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,239 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=848a3a18cbe98cc320d08ba07b8ba96b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:32,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:32,239 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412239"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412239"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412239"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412239"}]},"ts":"1676203412239"} 2023-02-12 12:03:32,240 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:32,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08d929761de87e16486cc6686e3347af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73498261, jitterRate=0.09520943462848663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08d929761de87e16486cc6686e3347af: Running coprocessor pre-open hook at 1676203412230Writing region info on filesystem at 1676203412230Initializing all the Stores at 1676203412231 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412231Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412231Cleaning up temporary data from old regions at 1676203412236 (+5 ms)Cleaning up detritus from prior splits at 1676203412237 (+1 ms)Running coprocessor post-open hooks at 1676203412241 (+4 ms)Region opened successfully at 1676203412241 2023-02-12 12:03:32,242 DEBUG [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1 2023-02-12 12:03:32,242 DEBUG [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1 2023-02-12 12:03:32,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af., pid=28, masterSystemTime=1676203412226 2023-02-12 12:03:32,242 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b4accc0c33226ffa7fd5dc4aa27cdc6 columnFamilyName f1 2023-02-12 12:03:32,243 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(310): Store=0b4accc0c33226ffa7fd5dc4aa27cdc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,243 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:32,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=13 2023-02-12 12:03:32,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=13, state=SUCCESS; OpenRegionProcedure 848a3a18cbe98cc320d08ba07b8ba96b, server=jenkins-hbase4.apache.org,44631,1676203410150 in 173 msec 2023-02-12 12:03:32,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:32,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:32,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:32,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 351ecbb77474c77ceb24de58cb2ad7ca, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 12:03:32,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=848a3a18cbe98cc320d08ba07b8ba96b, ASSIGN in 339 msec 2023-02-12 12:03:32,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:32,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:32,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:32,245 DEBUG [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2 2023-02-12 12:03:32,245 DEBUG [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2 2023-02-12 12:03:32,245 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=08d929761de87e16486cc6686e3347af, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,245 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b4accc0c33226ffa7fd5dc4aa27cdc6 columnFamilyName f2 2023-02-12 12:03:32,245 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203412245"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412245"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412245"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412245"}]},"ts":"1676203412245"} 2023-02-12 12:03:32,245 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:32,245 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(310): Store=0b4accc0c33226ffa7fd5dc4aa27cdc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:32,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:32,247 DEBUG [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1 2023-02-12 12:03:32,247 DEBUG [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1 2023-02-12 12:03:32,247 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 351ecbb77474c77ceb24de58cb2ad7ca columnFamilyName f1 2023-02-12 12:03:32,248 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(310): Store=351ecbb77474c77ceb24de58cb2ad7ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,248 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:32,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=11 2023-02-12 12:03:32,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=11, state=SUCCESS; OpenRegionProcedure 08d929761de87e16486cc6686e3347af, server=jenkins-hbase4.apache.org,38457,1676203410122 in 171 msec 2023-02-12 12:03:32,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08d929761de87e16486cc6686e3347af, ASSIGN in 344 msec 2023-02-12 12:03:32,249 DEBUG [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2 2023-02-12 12:03:32,249 DEBUG [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2 2023-02-12 12:03:32,250 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 351ecbb77474c77ceb24de58cb2ad7ca columnFamilyName f2 2023-02-12 12:03:32,250 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(310): Store=351ecbb77474c77ceb24de58cb2ad7ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:32,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:32,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:32,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0b4accc0c33226ffa7fd5dc4aa27cdc6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65311196, jitterRate=-0.02678734064102173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0b4accc0c33226ffa7fd5dc4aa27cdc6: Running coprocessor pre-open hook at 1676203412239Writing region info on filesystem at 1676203412239Initializing all the Stores at 1676203412240 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412240Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412240Cleaning up temporary data from old regions at 1676203412247 (+7 ms)Cleaning up detritus from prior splits at 1676203412248 (+1 ms)Running coprocessor post-open hooks at 1676203412252 (+4 ms)Region opened successfully at 1676203412252 2023-02-12 12:03:32,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6., pid=24, masterSystemTime=1676203412220 2023-02-12 12:03:32,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:32,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:32,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:32,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:32,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6e2e3201329af15e3eef03df24f2bddf, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 12:03:32,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0b4accc0c33226ffa7fd5dc4aa27cdc6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412255"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412255"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412255"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412255"}]},"ts":"1676203412255"} 2023-02-12 12:03:32,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:32,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:32,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:32,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 351ecbb77474c77ceb24de58cb2ad7ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66127949, jitterRate=-0.014616772532463074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 351ecbb77474c77ceb24de58cb2ad7ca: Running coprocessor pre-open hook at 1676203412244Writing region info on filesystem at 1676203412244Initializing all the Stores at 1676203412245 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412245Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412245Cleaning up temporary data from old regions at 1676203412251 (+6 ms)Cleaning up detritus from prior splits at 1676203412252 (+1 ms)Running coprocessor post-open hooks at 1676203412256 (+4 ms)Region opened successfully at 1676203412256 2023-02-12 12:03:32,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca., pid=26, masterSystemTime=1676203412226 2023-02-12 12:03:32,257 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:32,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:32,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:32,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:32,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2c3130a9983348c23f864030241d7275, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 12:03:32,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=351ecbb77474c77ceb24de58cb2ad7ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:32,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-12 12:03:32,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412258"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412258"}]},"ts":"1676203412258"} 2023-02-12 12:03:32,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure 0b4accc0c33226ffa7fd5dc4aa27cdc6, server=jenkins-hbase4.apache.org,44631,1676203410150 in 186 msec 2023-02-12 12:03:32,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:32,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:32,259 DEBUG [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1 2023-02-12 12:03:32,259 DEBUG [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1 2023-02-12 12:03:32,259 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e2e3201329af15e3eef03df24f2bddf columnFamilyName f1 2023-02-12 12:03:32,260 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:32,260 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(310): Store=6e2e3201329af15e3eef03df24f2bddf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,260 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:32,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b4accc0c33226ffa7fd5dc4aa27cdc6, ASSIGN in 354 msec 2023-02-12 12:03:32,261 DEBUG [StoreOpener-2c3130a9983348c23f864030241d7275-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1 2023-02-12 12:03:32,261 DEBUG [StoreOpener-2c3130a9983348c23f864030241d7275-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1 2023-02-12 12:03:32,261 DEBUG [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2 2023-02-12 12:03:32,261 DEBUG [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2 2023-02-12 12:03:32,261 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c3130a9983348c23f864030241d7275 columnFamilyName f1 2023-02-12 12:03:32,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=16 2023-02-12 12:03:32,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=16, state=SUCCESS; OpenRegionProcedure 351ecbb77474c77ceb24de58cb2ad7ca, server=jenkins-hbase4.apache.org,38457,1676203410122 in 185 msec 2023-02-12 12:03:32,261 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e2e3201329af15e3eef03df24f2bddf columnFamilyName f2 2023-02-12 12:03:32,262 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(310): Store=2c3130a9983348c23f864030241d7275/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,262 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:32,262 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(310): Store=6e2e3201329af15e3eef03df24f2bddf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,262 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=351ecbb77474c77ceb24de58cb2ad7ca, ASSIGN in 357 msec 2023-02-12 12:03:32,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:32,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:32,263 DEBUG [StoreOpener-2c3130a9983348c23f864030241d7275-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2 2023-02-12 12:03:32,263 DEBUG [StoreOpener-2c3130a9983348c23f864030241d7275-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2 2023-02-12 12:03:32,263 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c3130a9983348c23f864030241d7275 columnFamilyName f2 2023-02-12 12:03:32,264 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(310): Store=2c3130a9983348c23f864030241d7275/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275 2023-02-12 12:03:32,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275 2023-02-12 12:03:32,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:32,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:32,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6e2e3201329af15e3eef03df24f2bddf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65031741, jitterRate=-0.030951544642448425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6e2e3201329af15e3eef03df24f2bddf: Running coprocessor pre-open hook at 1676203412255Writing region info on filesystem at 1676203412255Initializing all the Stores at 1676203412256 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412256Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412257 (+1 ms)Cleaning up temporary data from old regions at 1676203412264 (+7 ms)Cleaning up detritus from prior splits at 1676203412265 (+1 ms)Running coprocessor post-open hooks at 1676203412269 (+4 ms)Region opened successfully at 1676203412269 2023-02-12 12:03:32,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2c3130a9983348c23f864030241d7275; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67909095, jitterRate=0.011924371123313904}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2c3130a9983348c23f864030241d7275: Running coprocessor pre-open hook at 1676203412259Writing region info on filesystem at 1676203412259Initializing all the Stores at 1676203412259Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412259Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412259Cleaning up temporary data from old regions at 1676203412266 (+7 ms)Cleaning up detritus from prior splits at 1676203412267 (+1 ms)Running coprocessor post-open hooks at 1676203412271 (+4 ms)Region opened successfully at 1676203412271 2023-02-12 12:03:32,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf., pid=25, masterSystemTime=1676203412220 2023-02-12 12:03:32,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275., pid=30, masterSystemTime=1676203412226 2023-02-12 12:03:32,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:32,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:32,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:32,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8ae2df7fdfcc94c13f03c30905c97afe, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 12:03:32,278 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=2c3130a9983348c23f864030241d7275, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:32,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,278 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676203411798.2c3130a9983348c23f864030241d7275.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412278"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412278"}]},"ts":"1676203412278"} 2023-02-12 12:03:32,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:32,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:32,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:32,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:32,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:32,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1741f347554acb33c94d7a04a06b5759, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 12:03:32,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:32,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:32,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:32,280 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:32,280 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=6e2e3201329af15e3eef03df24f2bddf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,280 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412280"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412280"}]},"ts":"1676203412280"} 2023-02-12 12:03:32,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-12 12:03:32,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 2c3130a9983348c23f864030241d7275, server=jenkins-hbase4.apache.org,38457,1676203410122 in 203 msec 2023-02-12 12:03:32,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-12 12:03:32,287 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c3130a9983348c23f864030241d7275, ASSIGN in 381 msec 2023-02-12 12:03:32,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 6e2e3201329af15e3eef03df24f2bddf, server=jenkins-hbase4.apache.org,44631,1676203410150 in 211 msec 2023-02-12 12:03:32,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e2e3201329af15e3eef03df24f2bddf, ASSIGN in 383 msec 2023-02-12 12:03:32,289 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:32,290 DEBUG [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/f1 2023-02-12 12:03:32,290 DEBUG [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/f1 2023-02-12 12:03:32,290 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ae2df7fdfcc94c13f03c30905c97afe columnFamilyName f1 2023-02-12 12:03:32,291 DEBUG [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1 2023-02-12 12:03:32,291 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] regionserver.HStore(310): Store=8ae2df7fdfcc94c13f03c30905c97afe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,291 DEBUG [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1 2023-02-12 12:03:32,291 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:32,291 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1741f347554acb33c94d7a04a06b5759 columnFamilyName f1 2023-02-12 12:03:32,292 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(310): Store=1741f347554acb33c94d7a04a06b5759/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,292 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:32,292 DEBUG [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/f2 2023-02-12 12:03:32,293 DEBUG [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/f2 2023-02-12 12:03:32,293 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ae2df7fdfcc94c13f03c30905c97afe columnFamilyName f2 2023-02-12 12:03:32,293 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] regionserver.HStore(310): Store=8ae2df7fdfcc94c13f03c30905c97afe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,294 DEBUG [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2 2023-02-12 12:03:32,294 DEBUG [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2 2023-02-12 12:03:32,294 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1741f347554acb33c94d7a04a06b5759 columnFamilyName f2 2023-02-12 12:03:32,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:32,295 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(310): Store=1741f347554acb33c94d7a04a06b5759/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:32,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:32,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:32,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:32,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:32,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8ae2df7fdfcc94c13f03c30905c97afe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69033525, jitterRate=0.028679683804512024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8ae2df7fdfcc94c13f03c30905c97afe: Running coprocessor pre-open hook at 1676203412279Writing region info on filesystem at 1676203412279Initializing all the Stores at 1676203412279Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412279Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412280 (+1 ms)Cleaning up temporary data from old regions at 1676203412296 (+16 ms)Cleaning up detritus from prior splits at 1676203412296Running coprocessor post-open hooks at 1676203412301 (+5 ms)Region opened successfully at 1676203412301 2023-02-12 12:03:32,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe., pid=27, masterSystemTime=1676203412226 2023-02-12 12:03:32,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1741f347554acb33c94d7a04a06b5759; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59942909, jitterRate=-0.10678105056285858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1741f347554acb33c94d7a04a06b5759: Running coprocessor pre-open hook at 1676203412279Writing region info on filesystem at 1676203412279Initializing all the Stores at 1676203412280 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412280Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412289 (+9 ms)Cleaning up temporary data from old regions at 1676203412296 (+7 ms)Cleaning up detritus from prior splits at 1676203412297 (+1 ms)Running coprocessor post-open hooks at 1676203412302 (+5 ms)Region opened successfully at 1676203412302 2023-02-12 12:03:32,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759., pid=23, masterSystemTime=1676203412220 2023-02-12 12:03:32,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:32,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:32,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:32,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2ee046517bff49ca9065bc171bb2e44b, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 12:03:32,305 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8ae2df7fdfcc94c13f03c30905c97afe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:32,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:32,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:32,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:32,305 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203412304"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412304"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412304"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412304"}]},"ts":"1676203412304"} 2023-02-12 12:03:32,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2c10d8776c481f0b5ffdcfbe99a6d164, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 12:03:32,305 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1741f347554acb33c94d7a04a06b5759, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,306 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412305"}]},"ts":"1676203412305"} 2023-02-12 12:03:32,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:32,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:32,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:32,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:32,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:32,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:32,307 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:32,308 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:32,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-12 12:03:32,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 8ae2df7fdfcc94c13f03c30905c97afe, server=jenkins-hbase4.apache.org,38457,1676203410122 in 232 msec 2023-02-12 12:03:32,309 DEBUG [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1 2023-02-12 12:03:32,309 DEBUG [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1 2023-02-12 12:03:32,309 DEBUG [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1 2023-02-12 12:03:32,309 DEBUG [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1 2023-02-12 12:03:32,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-12 12:03:32,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 1741f347554acb33c94d7a04a06b5759, server=jenkins-hbase4.apache.org,44631,1676203410150 in 238 msec 2023-02-12 12:03:32,310 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ee046517bff49ca9065bc171bb2e44b columnFamilyName f1 2023-02-12 12:03:32,310 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c10d8776c481f0b5ffdcfbe99a6d164 columnFamilyName f1 2023-02-12 12:03:32,310 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(310): Store=2ee046517bff49ca9065bc171bb2e44b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,310 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(310): Store=2c10d8776c481f0b5ffdcfbe99a6d164/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,310 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:32,310 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:32,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ae2df7fdfcc94c13f03c30905c97afe, ASSIGN in 405 msec 2023-02-12 12:03:32,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1741f347554acb33c94d7a04a06b5759, ASSIGN in 406 msec 2023-02-12 12:03:32,312 DEBUG [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2 2023-02-12 12:03:32,312 DEBUG [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2 2023-02-12 12:03:32,312 DEBUG [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2 2023-02-12 12:03:32,312 DEBUG [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2 2023-02-12 12:03:32,312 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ee046517bff49ca9065bc171bb2e44b columnFamilyName f2 2023-02-12 12:03:32,312 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c10d8776c481f0b5ffdcfbe99a6d164 columnFamilyName f2 2023-02-12 12:03:32,313 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(310): Store=2ee046517bff49ca9065bc171bb2e44b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,313 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(310): Store=2c10d8776c481f0b5ffdcfbe99a6d164/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:32,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:32,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:32,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:32,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:32,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:32,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:32,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:32,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:32,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2ee046517bff49ca9065bc171bb2e44b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70345773, jitterRate=0.04823370277881622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2c10d8776c481f0b5ffdcfbe99a6d164; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58729635, jitterRate=-0.1248602420091629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:32,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2ee046517bff49ca9065bc171bb2e44b: Running coprocessor pre-open hook at 1676203412306Writing region info on filesystem at 1676203412306Initializing all the Stores at 1676203412307 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412307Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412307Cleaning up temporary data from old regions at 1676203412314 (+7 ms)Cleaning up detritus from prior splits at 1676203412315 (+1 ms)Running coprocessor post-open hooks at 1676203412320 (+5 ms)Region opened successfully at 1676203412320 2023-02-12 12:03:32,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2c10d8776c481f0b5ffdcfbe99a6d164: Running coprocessor pre-open hook at 1676203412307Writing region info on filesystem at 1676203412307Initializing all the Stores at 1676203412308 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412308Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203412308Cleaning up temporary data from old regions at 1676203412315 (+7 ms)Cleaning up detritus from prior splits at 1676203412315Running coprocessor post-open hooks at 1676203412320 (+5 ms)Region opened successfully at 1676203412320 2023-02-12 12:03:32,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164., pid=22, masterSystemTime=1676203412220 2023-02-12 12:03:32,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b., pid=29, masterSystemTime=1676203412226 2023-02-12 12:03:32,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:32,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:32,323 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=2ee046517bff49ca9065bc171bb2e44b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,323 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412323"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412323"}]},"ts":"1676203412323"} 2023-02-12 12:03:32,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:32,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:32,323 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2c10d8776c481f0b5ffdcfbe99a6d164, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,323 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203412323"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203412323"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203412323"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203412323"}]},"ts":"1676203412323"} 2023-02-12 12:03:32,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-12 12:03:32,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 2ee046517bff49ca9065bc171bb2e44b, server=jenkins-hbase4.apache.org,38457,1676203410122 in 247 msec 2023-02-12 12:03:32,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-12 12:03:32,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure 2c10d8776c481f0b5ffdcfbe99a6d164, server=jenkins-hbase4.apache.org,44631,1676203410150 in 256 msec 2023-02-12 12:03:32,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ee046517bff49ca9065bc171bb2e44b, ASSIGN in 422 msec 2023-02-12 12:03:32,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-12 12:03:32,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c10d8776c481f0b5ffdcfbe99a6d164, ASSIGN in 423 msec 2023-02-12 12:03:32,329 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:32,330 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203412329"}]},"ts":"1676203412329"} 2023-02-12 12:03:32,331 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-12 12:03:32,333 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:32,334 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 534 msec 2023-02-12 12:03:32,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:32,408 INFO [Listener at localhost/37189] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-12 12:03:32,408 DEBUG [Listener at localhost/37189] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-12 12:03:32,408 INFO [Listener at localhost/37189] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:32,411 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-12 12:03:32,411 INFO [Listener at localhost/37189] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:32,411 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-12 12:03:32,411 INFO [Listener at localhost/37189] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 12:03:32,446 DEBUG [hconnection-0x7b745d22-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:32,456 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38457] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:32,459 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47010, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:32,467 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44631] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:32,606 INFO [Listener at localhost/37189] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 12:03:32,606 INFO [Listener at localhost/37189] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 12:03:32,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 12:03:32,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676203412608 (current time:1676203412608). 2023-02-12 12:03:32,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 12:03:32,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] zookeeper.ReadOnlyZKClient(139): Connect 0x7c6f03f7 to 127.0.0.1:62383 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:32,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22ea796b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:32,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:32,617 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:32,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c6f03f7 to 127.0.0.1:62383 2023-02-12 12:03:32,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:32,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 12:03:32,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 12:03:32,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 12:03:32,623 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 12:03:32,624 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676204012624 2023-02-12 12:03:32,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 12:03:32,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,631 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 12:03:32,631 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:32,631 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 12:03:32,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 12:03:32,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 10 msec 2023-02-12 12:03:32,633 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 12:03:32,633 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676204012633 2023-02-12 12:03:32,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,649 INFO [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 12:03:32,649 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:32,650 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 12:03:32,651 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 12:03:32,721 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,721 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,725 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:32,725 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:32,725 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:32,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:32,725 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,725 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,726 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,726 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,726 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 12:03:32,727 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:32,727 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 12:03:32,729 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 12:03:32,729 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:32,729 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 12:03:32,729 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 12:03:32,729 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 12:03:32,729 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38457,1676203410122' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 12:03:32,729 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44631,1676203410150' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 12:03:32,730 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,730 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,730 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:32,730 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,731 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,731 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:32,731 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,731 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,732 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:32,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44631,1676203410150' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 12:03:32,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7046b3df[Count = 1] remaining members to acquire global barrier 2023-02-12 12:03:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:32,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 12:03:32,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:32,733 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 12:03:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:32,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38457,1676203410122' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 12:03:32,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7046b3df[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:32,734 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 12:03:32,734 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,735 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,735 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,736 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 12:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 12:03:32,736 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,736 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:32,736 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:32,736 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:32,736 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. started... 2023-02-12 12:03:32,736 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 12:03:32,736 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:32,737 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 351ecbb77474c77ceb24de58cb2ad7ca 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:32,736 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. started... 2023-02-12 12:03:32,737 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:32,737 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 12:03:32,738 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 848a3a18cbe98cc320d08ba07b8ba96b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:32,736 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. started... 2023-02-12 12:03:32,736 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:32,738 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:32,738 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. started... 2023-02-12 12:03:32,737 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. started... 2023-02-12 12:03:32,738 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. started... 2023-02-12 12:03:32,739 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2c3130a9983348c23f864030241d7275 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:32,739 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0b4accc0c33226ffa7fd5dc4aa27cdc6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 12:03:32,739 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2ee046517bff49ca9065bc171bb2e44b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:32,739 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 6e2e3201329af15e3eef03df24f2bddf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:32,760 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/.tmp/f1/5fb36466f60e47a0a293100c4e4e87e9 2023-02-12 12:03:32,772 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/.tmp/f1/997d03dbea4549919da412ddc0e975b8 2023-02-12 12:03:32,787 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/.tmp/f1/e9b297cd62fb4ffe93c58c295f6bcb85 2023-02-12 12:03:32,791 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/.tmp/f1/ac8d08693b704224bfcfe609ae5eac02 2023-02-12 12:03:32,800 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/.tmp/f1/05c108801017462dbbc765f2c5fb7dcf 2023-02-12 12:03:32,820 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/.tmp/f1/4284ad9d63124d4d88500ddc974d7ccd 2023-02-12 12:03:32,825 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/.tmp/f2/8271070620704809987a404dc23c96c2 2023-02-12 12:03:32,830 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/.tmp/f1/5fb36466f60e47a0a293100c4e4e87e9 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/5fb36466f60e47a0a293100c4e4e87e9 2023-02-12 12:03:32,835 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/5fb36466f60e47a0a293100c4e4e87e9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,835 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/.tmp/f2/8271070620704809987a404dc23c96c2 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/8271070620704809987a404dc23c96c2 2023-02-12 12:03:32,839 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/8271070620704809987a404dc23c96c2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,840 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 351ecbb77474c77ceb24de58cb2ad7ca in 103ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:32,840 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-12 12:03:32,840 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 351ecbb77474c77ceb24de58cb2ad7ca: 2023-02-12 12:03:32,841 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,849 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:32,849 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/5fb36466f60e47a0a293100c4e4e87e9] hfiles 2023-02-12 12:03:32,849 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/5fb36466f60e47a0a293100c4e4e87e9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,849 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/8271070620704809987a404dc23c96c2] hfiles 2023-02-12 12:03:32,849 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/8271070620704809987a404dc23c96c2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,852 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/.tmp/f2/5700c205c94e459cb7f097baefd118b5 2023-02-12 12:03:32,853 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/.tmp/f2/a32610ebb6c445e287ec030b48cb8d99 2023-02-12 12:03:32,854 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/.tmp/f2/8e4e86903cb44f0dbadd1d73395b1d69 2023-02-12 12:03:32,862 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/.tmp/f1/ac8d08693b704224bfcfe609ae5eac02 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/ac8d08693b704224bfcfe609ae5eac02 2023-02-12 12:03:32,866 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/.tmp/f1/997d03dbea4549919da412ddc0e975b8 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/997d03dbea4549919da412ddc0e975b8 2023-02-12 12:03:32,867 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/ac8d08693b704224bfcfe609ae5eac02, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,868 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/.tmp/f2/08e58ef2b1b241ed9d12e55312fa5904 2023-02-12 12:03:32,868 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/.tmp/f2/8e4e86903cb44f0dbadd1d73395b1d69 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/8e4e86903cb44f0dbadd1d73395b1d69 2023-02-12 12:03:32,869 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/.tmp/f1/e9b297cd62fb4ffe93c58c295f6bcb85 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/e9b297cd62fb4ffe93c58c295f6bcb85 2023-02-12 12:03:32,871 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/997d03dbea4549919da412ddc0e975b8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,872 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. completed. 2023-02-12 12:03:32,872 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:32,872 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:32,872 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 12:03:32,872 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. started... 2023-02-12 12:03:32,872 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/.tmp/f2/a32610ebb6c445e287ec030b48cb8d99 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/a32610ebb6c445e287ec030b48cb8d99 2023-02-12 12:03:32,874 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/8e4e86903cb44f0dbadd1d73395b1d69, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,875 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2ee046517bff49ca9065bc171bb2e44b in 135ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:32,875 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/.tmp/f1/4284ad9d63124d4d88500ddc974d7ccd as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/4284ad9d63124d4d88500ddc974d7ccd 2023-02-12 12:03:32,877 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/a32610ebb6c445e287ec030b48cb8d99, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,878 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2c3130a9983348c23f864030241d7275 in 139ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:32,878 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/4284ad9d63124d4d88500ddc974d7ccd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,879 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/.tmp/f2/08e58ef2b1b241ed9d12e55312fa5904 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/08e58ef2b1b241ed9d12e55312fa5904 2023-02-12 12:03:32,882 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8ae2df7fdfcc94c13f03c30905c97afe: 2023-02-12 12:03:32,882 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2ee046517bff49ca9065bc171bb2e44b: 2023-02-12 12:03:32,882 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2c3130a9983348c23f864030241d7275: 2023-02-12 12:03:32,882 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/ac8d08693b704224bfcfe609ae5eac02] hfiles 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/997d03dbea4549919da412ddc0e975b8] hfiles 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/997d03dbea4549919da412ddc0e975b8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/a32610ebb6c445e287ec030b48cb8d99] hfiles 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/a32610ebb6c445e287ec030b48cb8d99 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,883 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/e9b297cd62fb4ffe93c58c295f6bcb85, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/ac8d08693b704224bfcfe609ae5eac02 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/8e4e86903cb44f0dbadd1d73395b1d69] hfiles 2023-02-12 12:03:32,883 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:32,884 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/8e4e86903cb44f0dbadd1d73395b1d69 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,884 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/.tmp/f2/5700c205c94e459cb7f097baefd118b5 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/5700c205c94e459cb7f097baefd118b5 2023-02-12 12:03:32,887 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/08e58ef2b1b241ed9d12e55312fa5904, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,888 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6e2e3201329af15e3eef03df24f2bddf in 149ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:32,888 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 6e2e3201329af15e3eef03df24f2bddf: 2023-02-12 12:03:32,888 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,893 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:32,893 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/4284ad9d63124d4d88500ddc974d7ccd] hfiles 2023-02-12 12:03:32,893 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/4284ad9d63124d4d88500ddc974d7ccd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,893 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/08e58ef2b1b241ed9d12e55312fa5904] hfiles 2023-02-12 12:03:32,893 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/08e58ef2b1b241ed9d12e55312fa5904 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,893 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/.tmp/f2/91e53aa8d65348b3bab459f5dc06cd03 2023-02-12 12:03:32,898 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/5700c205c94e459cb7f097baefd118b5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,898 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 848a3a18cbe98cc320d08ba07b8ba96b in 160ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:32,899 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 848a3a18cbe98cc320d08ba07b8ba96b: 2023-02-12 12:03:32,899 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,899 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:32,899 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/e9b297cd62fb4ffe93c58c295f6bcb85] hfiles 2023-02-12 12:03:32,899 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/e9b297cd62fb4ffe93c58c295f6bcb85 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,899 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/5700c205c94e459cb7f097baefd118b5] hfiles 2023-02-12 12:03:32,899 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/5700c205c94e459cb7f097baefd118b5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,908 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. completed. 2023-02-12 12:03:32,908 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:32,908 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:32,908 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 12:03:32,908 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. started... 2023-02-12 12:03:32,913 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 08d929761de87e16486cc6686e3347af: 2023-02-12 12:03:32,913 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,913 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:32,913 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:32,913 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 12:03:32,915 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. completed. 2023-02-12 12:03:32,915 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:32,915 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 12:03:32,915 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/.tmp/f1/05c108801017462dbbc765f2c5fb7dcf as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/05c108801017462dbbc765f2c5fb7dcf 2023-02-12 12:03:32,919 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/05c108801017462dbbc765f2c5fb7dcf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:32,920 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/.tmp/f2/91e53aa8d65348b3bab459f5dc06cd03 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/91e53aa8d65348b3bab459f5dc06cd03 2023-02-12 12:03:32,920 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. completed. 2023-02-12 12:03:32,920 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:32,920 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 12:03:32,924 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. completed. 2023-02-12 12:03:32,924 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:32,924 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:32,924 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. completed. 2023-02-12 12:03:32,924 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:32,924 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. started... 2023-02-12 12:03:32,924 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:32,924 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. started... 2023-02-12 12:03:32,925 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 12:03:32,925 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1741f347554acb33c94d7a04a06b5759 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 12:03:32,926 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 2c10d8776c481f0b5ffdcfbe99a6d164 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 12:03:32,925 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 12:03:32,927 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/91e53aa8d65348b3bab459f5dc06cd03, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:32,930 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 0b4accc0c33226ffa7fd5dc4aa27cdc6 in 191ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:32,930 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0b4accc0c33226ffa7fd5dc4aa27cdc6: 2023-02-12 12:03:32,930 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,930 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:32,930 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/05c108801017462dbbc765f2c5fb7dcf] hfiles 2023-02-12 12:03:32,930 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/05c108801017462dbbc765f2c5fb7dcf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,930 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/91e53aa8d65348b3bab459f5dc06cd03] hfiles 2023-02-12 12:03:32,930 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/91e53aa8d65348b3bab459f5dc06cd03 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,933 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:32,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 12:03:32,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:32,935 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 12:03:32,942 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. completed. 2023-02-12 12:03:32,942 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 12:03:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 12:03:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 12:03:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38457,1676203410122' in zk 2023-02-12 12:03:32,944 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:32,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:32,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:32,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:32,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:32,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38457,1676203410122': 2023-02-12 12:03:32,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38457,1676203410122' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 12:03:32,948 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 12:03:32,948 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:32,948 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 12:03:32,955 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/.tmp/f1/e7d886b4c9c74eaea8fc70d0abeff332 2023-02-12 12:03:32,960 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/.tmp/f1/c9ac967a19cc46f2b28c158586bde644 2023-02-12 12:03:32,985 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/.tmp/f2/6f90ba4c71bb4199b2ba794b2eab3a1d 2023-02-12 12:03:32,985 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/.tmp/f2/30a821b2a5594a26b067d45a0c7304eb 2023-02-12 12:03:32,990 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/.tmp/f1/c9ac967a19cc46f2b28c158586bde644 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/c9ac967a19cc46f2b28c158586bde644 2023-02-12 12:03:32,990 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/.tmp/f1/e7d886b4c9c74eaea8fc70d0abeff332 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/e7d886b4c9c74eaea8fc70d0abeff332 2023-02-12 12:03:32,994 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/c9ac967a19cc46f2b28c158586bde644, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:32,995 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/e7d886b4c9c74eaea8fc70d0abeff332, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:32,995 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/.tmp/f2/6f90ba4c71bb4199b2ba794b2eab3a1d as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/6f90ba4c71bb4199b2ba794b2eab3a1d 2023-02-12 12:03:32,996 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/.tmp/f2/30a821b2a5594a26b067d45a0c7304eb as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/30a821b2a5594a26b067d45a0c7304eb 2023-02-12 12:03:33,000 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/6f90ba4c71bb4199b2ba794b2eab3a1d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 12:03:33,000 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/30a821b2a5594a26b067d45a0c7304eb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 12:03:33,001 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 1741f347554acb33c94d7a04a06b5759 in 76ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:33,001 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2c10d8776c481f0b5ffdcfbe99a6d164 in 75ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:33,001 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1741f347554acb33c94d7a04a06b5759: 2023-02-12 12:03:33,001 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 2c10d8776c481f0b5ffdcfbe99a6d164: 2023-02-12 12:03:33,001 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,001 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,001 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:33,001 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:33,001 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/c9ac967a19cc46f2b28c158586bde644] hfiles 2023-02-12 12:03:33,002 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/c9ac967a19cc46f2b28c158586bde644 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,002 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/e7d886b4c9c74eaea8fc70d0abeff332] hfiles 2023-02-12 12:03:33,002 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/e7d886b4c9c74eaea8fc70d0abeff332 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,002 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/6f90ba4c71bb4199b2ba794b2eab3a1d] hfiles 2023-02-12 12:03:33,002 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/6f90ba4c71bb4199b2ba794b2eab3a1d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,002 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/30a821b2a5594a26b067d45a0c7304eb] hfiles 2023-02-12 12:03:33,002 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/30a821b2a5594a26b067d45a0c7304eb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,012 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. completed. 2023-02-12 12:03:33,012 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. completed. 2023-02-12 12:03:33,012 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:33,012 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:33,012 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 12:03:33,012 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 12:03:33,235 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 12:03:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:33,236 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 12:03:33,355 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. completed. 2023-02-12 12:03:33,356 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:33,356 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 12:03:33,356 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 12:03:33,356 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,356 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 12:03:33,356 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44631,1676203410150' in zk 2023-02-12 12:03:33,364 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 12:03:33,364 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,364 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:33,364 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 12:03:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:33,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44631,1676203410150': 2023-02-12 12:03:33,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44631,1676203410150' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 12:03:33,366 INFO [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 12:03:33,367 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:33,367 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:33,367 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,367 INFO [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 12:03:33,368 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,369 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,369 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,369 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:33,369 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:33,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:33,369 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:33,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:33,370 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:33,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,371 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,371 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:33,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,376 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:33,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:33,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,377 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:33,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:33,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:33,377 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:33,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,439 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-12 12:03:33,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,440 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676203412628Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676203413377 (+749 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676203413377Writing data manifest for testWithMockedMapReduceMultiRegion at 1676203413384 (+7 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676203413400 (+16 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676203413439 (+39 ms) 2023-02-12 12:03:33,442 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 12:03:33,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 811 msec 2023-02-12 12:03:33,737 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:33,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 12:03:33,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 12:03:33,738 INFO [Listener at localhost/37189] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 12:03:33,743 INFO [Listener at localhost/37189] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 12:03:33,749 INFO [Listener at localhost/37189] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 12:03:33,775 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38457] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:33,785 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44631] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:33,846 INFO [Listener at localhost/37189] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 12:03:33,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 12:03:33,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,853 INFO [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 12:03:33,853 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:33,854 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 12:03:33,854 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 12:03:33,855 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,855 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,857 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:33,857 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:33,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:33,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:33,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:33,857 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:33,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,857 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:33,857 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,858 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:33,858 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:33,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,858 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,858 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 12:03:33,859 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 12:03:33,859 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:33,863 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 12:03:33,863 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 12:03:33,863 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:33,863 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:33,863 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:33,863 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. started... 2023-02-12 12:03:33,863 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 12:03:33,863 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:33,863 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:33,863 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 848a3a18cbe98cc320d08ba07b8ba96b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:33,864 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 12:03:33,863 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. started... 2023-02-12 12:03:33,863 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. started... 2023-02-12 12:03:33,864 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 6e2e3201329af15e3eef03df24f2bddf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:33,864 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0b4accc0c33226ffa7fd5dc4aa27cdc6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 12:03:33,864 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:33,864 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:33,864 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. started... 2023-02-12 12:03:33,864 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 12:03:33,865 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:33,865 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 351ecbb77474c77ceb24de58cb2ad7ca 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:33,864 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. started... 2023-02-12 12:03:33,865 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:33,865 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. started... 2023-02-12 12:03:33,865 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2ee046517bff49ca9065bc171bb2e44b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:33,866 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2c3130a9983348c23f864030241d7275 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:33,900 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/.tmp/f1/2bd0566c992f45f8958842c5723c6876 2023-02-12 12:03:33,900 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/.tmp/f1/a8439974bf414ed4adb25c6c5536576e 2023-02-12 12:03:33,901 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/.tmp/f1/44d13609d1e545f28f87e828419ac541 2023-02-12 12:03:33,905 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/.tmp/f1/b532c42b8b44444992dc3177d343a873 2023-02-12 12:03:33,906 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/.tmp/f1/c60313a90a5d48bb8e53fe809c6e56e2 2023-02-12 12:03:33,920 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/.tmp/f1/e5b7f9173acc4ed59bcbd1bd9dc5af90 2023-02-12 12:03:33,948 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/.tmp/f2/c687414d07234dd4b923a3619a224234 2023-02-12 12:03:33,953 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/.tmp/f2/921fca19e1404e93b1c5cc1a934ba574 2023-02-12 12:03:33,954 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/.tmp/f1/a8439974bf414ed4adb25c6c5536576e as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/a8439974bf414ed4adb25c6c5536576e 2023-02-12 12:03:33,956 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/.tmp/f2/547e060509a340f7ac8e7f10cc352dfa 2023-02-12 12:03:33,961 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/.tmp/f1/44d13609d1e545f28f87e828419ac541 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/44d13609d1e545f28f87e828419ac541 2023-02-12 12:03:33,961 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/a8439974bf414ed4adb25c6c5536576e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:33,962 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/.tmp/f2/c687414d07234dd4b923a3619a224234 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/c687414d07234dd4b923a3619a224234 2023-02-12 12:03:33,963 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/.tmp/f1/2bd0566c992f45f8958842c5723c6876 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/2bd0566c992f45f8958842c5723c6876 2023-02-12 12:03:33,965 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/44d13609d1e545f28f87e828419ac541, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:33,967 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/c687414d07234dd4b923a3619a224234, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:33,968 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/.tmp/f2/547e060509a340f7ac8e7f10cc352dfa as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/547e060509a340f7ac8e7f10cc352dfa 2023-02-12 12:03:33,969 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/2bd0566c992f45f8958842c5723c6876, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:33,969 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2ee046517bff49ca9065bc171bb2e44b in 104ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:33,969 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2ee046517bff49ca9065bc171bb2e44b: 2023-02-12 12:03:33,969 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:33,972 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/.tmp/f2/921fca19e1404e93b1c5cc1a934ba574 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/921fca19e1404e93b1c5cc1a934ba574 2023-02-12 12:03:33,977 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/547e060509a340f7ac8e7f10cc352dfa, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:33,977 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/921fca19e1404e93b1c5cc1a934ba574, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:33,978 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 0b4accc0c33226ffa7fd5dc4aa27cdc6 in 114ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0b4accc0c33226ffa7fd5dc4aa27cdc6: 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:33,978 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 351ecbb77474c77ceb24de58cb2ad7ca in 113ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 351ecbb77474c77ceb24de58cb2ad7ca: 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. started... 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8ae2df7fdfcc94c13f03c30905c97afe: 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. started... 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 08d929761de87e16486cc6686e3347af: 2023-02-12 12:03:33,978 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:33,980 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/.tmp/f2/c1bc326e3d454630a0a0d9b51cf777f2 2023-02-12 12:03:33,980 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 12:03:33,980 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 12:03:33,980 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 12:03:33,980 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 12:03:33,980 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/.tmp/f2/10c06396d05a476f999d280386e1eeae 2023-02-12 12:03:33,981 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:33,981 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. started... 2023-02-12 12:03:33,981 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 12:03:33,981 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1741f347554acb33c94d7a04a06b5759 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 12:03:33,984 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/.tmp/f2/fc11ad4f3c5149c4a65eb0affebed81a 2023-02-12 12:03:33,988 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/.tmp/f1/c60313a90a5d48bb8e53fe809c6e56e2 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/c60313a90a5d48bb8e53fe809c6e56e2 2023-02-12 12:03:33,989 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/.tmp/f1/e5b7f9173acc4ed59bcbd1bd9dc5af90 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/e5b7f9173acc4ed59bcbd1bd9dc5af90 2023-02-12 12:03:33,991 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/.tmp/f1/b532c42b8b44444992dc3177d343a873 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/b532c42b8b44444992dc3177d343a873 2023-02-12 12:03:33,996 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/.tmp/f1/7d8cf35fe1784f188e09a2542f2c8e05 2023-02-12 12:03:33,997 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/b532c42b8b44444992dc3177d343a873, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:33,997 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/e5b7f9173acc4ed59bcbd1bd9dc5af90, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:33,998 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/.tmp/f2/fc11ad4f3c5149c4a65eb0affebed81a as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/fc11ad4f3c5149c4a65eb0affebed81a 2023-02-12 12:03:33,998 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/.tmp/f2/10c06396d05a476f999d280386e1eeae as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/10c06396d05a476f999d280386e1eeae 2023-02-12 12:03:33,998 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/c60313a90a5d48bb8e53fe809c6e56e2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:33,999 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/.tmp/f2/c1bc326e3d454630a0a0d9b51cf777f2 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/c1bc326e3d454630a0a0d9b51cf777f2 2023-02-12 12:03:34,003 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/10c06396d05a476f999d280386e1eeae, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:34,005 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/c1bc326e3d454630a0a0d9b51cf777f2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:34,005 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/fc11ad4f3c5149c4a65eb0affebed81a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:34,008 INFO [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2c3130a9983348c23f864030241d7275 in 143ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:34,008 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 848a3a18cbe98cc320d08ba07b8ba96b in 145ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:34,008 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6e2e3201329af15e3eef03df24f2bddf in 144ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:34,008 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 848a3a18cbe98cc320d08ba07b8ba96b: 2023-02-12 12:03:34,008 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2c3130a9983348c23f864030241d7275: 2023-02-12 12:03:34,009 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:34,009 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 6e2e3201329af15e3eef03df24f2bddf: 2023-02-12 12:03:34,009 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 12:03:34,009 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:34,009 DEBUG [rs(jenkins-hbase4.apache.org,38457,1676203410122)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:34,009 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. started... 2023-02-12 12:03:34,009 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 12:03:34,009 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:34,009 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2c10d8776c481f0b5ffdcfbe99a6d164 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 12:03:34,009 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 12:03:34,009 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 12:03:34,009 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,009 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 12:03:34,009 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38457,1676203410122' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 12:03:34,013 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,013 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:34,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:34,013 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,013 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:34,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:34,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:34,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:34,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38457,1676203410122' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 12:03:34,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7479290f[Count = 1] remaining members to acquire global barrier 2023-02-12 12:03:34,026 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/.tmp/f1/3569522581424d99ae462691cb332ea3 2023-02-12 12:03:34,027 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/.tmp/f2/7d8f819a33fb49398eeb5bb41077b1ea 2023-02-12 12:03:34,036 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/.tmp/f1/7d8cf35fe1784f188e09a2542f2c8e05 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/7d8cf35fe1784f188e09a2542f2c8e05 2023-02-12 12:03:34,040 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/7d8cf35fe1784f188e09a2542f2c8e05, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:34,041 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/.tmp/f2/7d8f819a33fb49398eeb5bb41077b1ea as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/7d8f819a33fb49398eeb5bb41077b1ea 2023-02-12 12:03:34,045 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/7d8f819a33fb49398eeb5bb41077b1ea, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 12:03:34,046 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 1741f347554acb33c94d7a04a06b5759 in 65ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:34,046 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1741f347554acb33c94d7a04a06b5759: 2023-02-12 12:03:34,046 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:34,046 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 12:03:34,050 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/.tmp/f2/fdcf508a734b43b6896e93771b458be0 2023-02-12 12:03:34,054 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/.tmp/f1/3569522581424d99ae462691cb332ea3 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/3569522581424d99ae462691cb332ea3 2023-02-12 12:03:34,058 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/3569522581424d99ae462691cb332ea3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:34,058 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/.tmp/f2/fdcf508a734b43b6896e93771b458be0 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/fdcf508a734b43b6896e93771b458be0 2023-02-12 12:03:34,062 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/fdcf508a734b43b6896e93771b458be0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 12:03:34,063 INFO [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2c10d8776c481f0b5ffdcfbe99a6d164 in 54ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:34,063 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2c10d8776c481f0b5ffdcfbe99a6d164: 2023-02-12 12:03:34,063 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676203410150)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:34,063 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 12:03:34,063 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 12:03:34,063 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,063 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 12:03:34,064 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44631,1676203410150' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 12:03:34,069 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,069 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:34,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:34,070 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,070 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:34,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:34,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:34,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:34,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44631,1676203410150' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 12:03:34,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7479290f[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:34,071 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 12:03:34,071 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,076 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,076 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,076 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 12:03:34,076 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 12:03:34,076 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,076 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 12:03:34,076 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 12:03:34,076 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38457,1676203410122' in zk 2023-02-12 12:03:34,076 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44631,1676203410150' in zk 2023-02-12 12:03:34,077 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,077 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:34,080 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 12:03:34,080 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,080 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:34,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:34,080 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676203410150' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 12:03:34,083 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 12:03:34,083 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:34,083 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:34,083 DEBUG [member: 'jenkins-hbase4.apache.org,38457,1676203410122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 12:03:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44631,1676203410150': 2023-02-12 12:03:34,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44631,1676203410150' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 12:03:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38457,1676203410122': 2023-02-12 12:03:34,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38457,1676203410122' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 12:03:34,088 INFO [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 12:03:34,088 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:34,088 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:34,088 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,088 INFO [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 12:03:34,091 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,091 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:34,091 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,091 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,092 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:34,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:34,092 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,092 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:34,094 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,094 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,097 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:34,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:34,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-12 12:03:34,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 12:03:34,098 DEBUG [(jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:34,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:34,098 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 12:03:34,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:34,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:34,199 DEBUG [Listener at localhost/37189] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 12:03:34,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 12:03:34,205 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676203412608 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:34,205 DEBUG [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,205 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(239): region to add: 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=351ecbb77474c77ceb24de58cb2ad7ca as 351ecbb77474c77ceb24de58cb2ad7ca in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=848a3a18cbe98cc320d08ba07b8ba96b as 848a3a18cbe98cc320d08ba07b8ba96b in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=6e2e3201329af15e3eef03df24f2bddf as 6e2e3201329af15e3eef03df24f2bddf in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,206 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=2ee046517bff49ca9065bc171bb2e44b as 2ee046517bff49ca9065bc171bb2e44b in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,207 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=0b4accc0c33226ffa7fd5dc4aa27cdc6 as 0b4accc0c33226ffa7fd5dc4aa27cdc6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,207 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=1741f347554acb33c94d7a04a06b5759 as 1741f347554acb33c94d7a04a06b5759 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,207 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=2c3130a9983348c23f864030241d7275 as 2c3130a9983348c23f864030241d7275 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,207 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=8ae2df7fdfcc94c13f03c30905c97afe as 8ae2df7fdfcc94c13f03c30905c97afe in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,207 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=2c10d8776c481f0b5ffdcfbe99a6d164 as 2c10d8776c481f0b5ffdcfbe99a6d164 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,207 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(585): clone region=08d929761de87e16486cc6686e3347af as 08d929761de87e16486cc6686e3347af in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,208 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 2c3130a9983348c23f864030241d7275, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,209 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 848a3a18cbe98cc320d08ba07b8ba96b, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,209 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6e2e3201329af15e3eef03df24f2bddf, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,209 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 2ee046517bff49ca9065bc171bb2e44b, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,209 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 8ae2df7fdfcc94c13f03c30905c97afe, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,209 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 0b4accc0c33226ffa7fd5dc4aa27cdc6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,210 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 351ecbb77474c77ceb24de58cb2ad7ca, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,210 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 1741f347554acb33c94d7a04a06b5759, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,234 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,234 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ac8d08693b704224bfcfe609ae5eac02 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,249 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8e4e86903cb44f0dbadd1d73395b1d69 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,249 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,250 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 997d03dbea4549919da412ddc0e975b8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 8ae2df7fdfcc94c13f03c30905c97afe, disabling compactions & flushes 2023-02-12 12:03:34,265 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:34,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:34,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. after waiting 0 ms 2023-02-12 12:03:34,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:34,265 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:34,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 8ae2df7fdfcc94c13f03c30905c97afe: Waiting for close lock at 1676203414265Disabling compacts and flushes for region at 1676203414265Disabling writes for close at 1676203414265Writing region close event to WAL at 1676203414265Closed at 1676203414265 2023-02-12 12:03:34,265 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a32610ebb6c445e287ec030b48cb8d99 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,266 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 2ee046517bff49ca9065bc171bb2e44b, disabling compactions & flushes 2023-02-12 12:03:34,266 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:34,266 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5fb36466f60e47a0a293100c4e4e87e9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,267 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,267 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 05c108801017462dbbc765f2c5fb7dcf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,266 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2c10d8776c481f0b5ffdcfbe99a6d164, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,266 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:34,267 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. after waiting 0 ms 2023-02-12 12:03:34,267 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:34,267 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:34,267 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 2ee046517bff49ca9065bc171bb2e44b: Waiting for close lock at 1676203414266Disabling compacts and flushes for region at 1676203414266Disabling writes for close at 1676203414267 (+1 ms)Writing region close event to WAL at 1676203414267Closed at 1676203414267 2023-02-12 12:03:34,268 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 08d929761de87e16486cc6686e3347af, NAME => 'testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,268 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,268 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e9b297cd62fb4ffe93c58c295f6bcb85 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,268 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,268 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4284ad9d63124d4d88500ddc974d7ccd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,268 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,269 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c9ac967a19cc46f2b28c158586bde644 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,271 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8271070620704809987a404dc23c96c2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,277 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91e53aa8d65348b3bab459f5dc06cd03 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 2c3130a9983348c23f864030241d7275, disabling compactions & flushes 2023-02-12 12:03:34,278 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:34,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:34,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. after waiting 0 ms 2023-02-12 12:03:34,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:34,278 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:34,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 2c3130a9983348c23f864030241d7275: Waiting for close lock at 1676203414278Disabling compacts and flushes for region at 1676203414278Disabling writes for close at 1676203414278Writing region close event to WAL at 1676203414278Closed at 1676203414278 2023-02-12 12:03:34,279 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5700c205c94e459cb7f097baefd118b5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,279 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 08e58ef2b1b241ed9d12e55312fa5904 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,287 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6f90ba4c71bb4199b2ba794b2eab3a1d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,287 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 6e2e3201329af15e3eef03df24f2bddf, disabling compactions & flushes 2023-02-12 12:03:34,288 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:34,288 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:34,288 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. after waiting 0 ms 2023-02-12 12:03:34,288 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:34,288 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:34,288 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 6e2e3201329af15e3eef03df24f2bddf: Waiting for close lock at 1676203414287Disabling compacts and flushes for region at 1676203414287Disabling writes for close at 1676203414288 (+1 ms)Writing region close event to WAL at 1676203414288Closed at 1676203414288 2023-02-12 12:03:34,288 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 0b4accc0c33226ffa7fd5dc4aa27cdc6, disabling compactions & flushes 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 351ecbb77474c77ceb24de58cb2ad7ca, disabling compactions & flushes 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 848a3a18cbe98cc320d08ba07b8ba96b, disabling compactions & flushes 2023-02-12 12:03:34,289 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:34,289 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:34,289 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. after waiting 0 ms 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:34,289 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 351ecbb77474c77ceb24de58cb2ad7ca: Waiting for close lock at 1676203414289Disabling compacts and flushes for region at 1676203414289Disabling writes for close at 1676203414289Writing region close event to WAL at 1676203414289Closed at 1676203414289 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. after waiting 0 ms 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. after waiting 0 ms 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:34,289 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:34,289 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:34,290 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:34,290 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 0b4accc0c33226ffa7fd5dc4aa27cdc6: Waiting for close lock at 1676203414288Disabling compacts and flushes for region at 1676203414288Disabling writes for close at 1676203414289 (+1 ms)Writing region close event to WAL at 1676203414289Closed at 1676203414289 2023-02-12 12:03:34,290 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 848a3a18cbe98cc320d08ba07b8ba96b: Waiting for close lock at 1676203414289Disabling compacts and flushes for region at 1676203414289Disabling writes for close at 1676203414289Writing region close event to WAL at 1676203414289Closed at 1676203414289 2023-02-12 12:03:34,292 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,292 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 08d929761de87e16486cc6686e3347af, disabling compactions & flushes 2023-02-12 12:03:34,292 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:34,292 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:34,292 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. after waiting 0 ms 2023-02-12 12:03:34,292 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:34,292 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:34,292 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 08d929761de87e16486cc6686e3347af: Waiting for close lock at 1676203414292Disabling compacts and flushes for region at 1676203414292Disabling writes for close at 1676203414292Writing region close event to WAL at 1676203414292Closed at 1676203414292 2023-02-12 12:03:34,294 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,294 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e7d886b4c9c74eaea8fc70d0abeff332 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,294 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 1741f347554acb33c94d7a04a06b5759, disabling compactions & flushes 2023-02-12 12:03:34,294 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:34,294 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:34,294 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. after waiting 0 ms 2023-02-12 12:03:34,294 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:34,294 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:34,294 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 1741f347554acb33c94d7a04a06b5759: Waiting for close lock at 1676203414294Disabling compacts and flushes for region at 1676203414294Disabling writes for close at 1676203414294Writing region close event to WAL at 1676203414294Closed at 1676203414294 2023-02-12 12:03:34,296 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 30a821b2a5594a26b067d45a0c7304eb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:34,297 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2c10d8776c481f0b5ffdcfbe99a6d164, disabling compactions & flushes 2023-02-12 12:03:34,297 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:34,297 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:34,297 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. after waiting 0 ms 2023-02-12 12:03:34,297 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:34,297 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:34,297 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2c10d8776c481f0b5ffdcfbe99a6d164: Waiting for close lock at 1676203414297Disabling compacts and flushes for region at 1676203414297Disabling writes for close at 1676203414297Writing region close event to WAL at 1676203414297Closed at 1676203414297 2023-02-12 12:03:34,298 INFO [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676203412608 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:34,298 DEBUG [Listener at localhost/37189] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,298 DEBUG [Listener at localhost/37189] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12 2023-02-12 12:03:34,299 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-data/ 2023-02-12 12:03:34,299 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----default/ 2023-02-12 12:03:34,299 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-12 12:03:34,300 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------08d929761de87e16486cc6686e3347af/ 2023-02-12 12:03:34,300 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,300 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------0b4accc0c33226ffa7fd5dc4aa27cdc6/ 2023-02-12 12:03:34,300 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,300 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:34,301 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0b4accc0c33226ffa7fd5dc4aa27cdc6-05c108801017462dbbc765f2c5fb7dcf 2023-02-12 12:03:34,301 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:34,301 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0b4accc0c33226ffa7fd5dc4aa27cdc6-91e53aa8d65348b3bab459f5dc06cd03 2023-02-12 12:03:34,301 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------1741f347554acb33c94d7a04a06b5759/ 2023-02-12 12:03:34,301 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,301 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:34,302 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1741f347554acb33c94d7a04a06b5759-c9ac967a19cc46f2b28c158586bde644 2023-02-12 12:03:34,302 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:34,302 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1741f347554acb33c94d7a04a06b5759-6f90ba4c71bb4199b2ba794b2eab3a1d 2023-02-12 12:03:34,302 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------2c10d8776c481f0b5ffdcfbe99a6d164/ 2023-02-12 12:03:34,302 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,302 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:34,303 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2c10d8776c481f0b5ffdcfbe99a6d164-e7d886b4c9c74eaea8fc70d0abeff332 2023-02-12 12:03:34,303 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:34,303 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2c10d8776c481f0b5ffdcfbe99a6d164-30a821b2a5594a26b067d45a0c7304eb 2023-02-12 12:03:34,303 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------2c3130a9983348c23f864030241d7275/ 2023-02-12 12:03:34,303 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,303 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:34,304 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2c3130a9983348c23f864030241d7275-997d03dbea4549919da412ddc0e975b8 2023-02-12 12:03:34,304 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:34,304 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2c3130a9983348c23f864030241d7275-a32610ebb6c445e287ec030b48cb8d99 2023-02-12 12:03:34,304 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------2ee046517bff49ca9065bc171bb2e44b/ 2023-02-12 12:03:34,304 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,304 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:34,305 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2ee046517bff49ca9065bc171bb2e44b-ac8d08693b704224bfcfe609ae5eac02 2023-02-12 12:03:34,305 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:34,305 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=2ee046517bff49ca9065bc171bb2e44b-8e4e86903cb44f0dbadd1d73395b1d69 2023-02-12 12:03:34,305 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------351ecbb77474c77ceb24de58cb2ad7ca/ 2023-02-12 12:03:34,305 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,305 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:34,306 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=351ecbb77474c77ceb24de58cb2ad7ca-5fb36466f60e47a0a293100c4e4e87e9 2023-02-12 12:03:34,306 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:34,306 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=351ecbb77474c77ceb24de58cb2ad7ca-8271070620704809987a404dc23c96c2 2023-02-12 12:03:34,306 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------6e2e3201329af15e3eef03df24f2bddf/ 2023-02-12 12:03:34,306 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,306 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:34,307 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6e2e3201329af15e3eef03df24f2bddf-4284ad9d63124d4d88500ddc974d7ccd 2023-02-12 12:03:34,307 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:34,307 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6e2e3201329af15e3eef03df24f2bddf-08e58ef2b1b241ed9d12e55312fa5904 2023-02-12 12:03:34,307 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------848a3a18cbe98cc320d08ba07b8ba96b/ 2023-02-12 12:03:34,307 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,307 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:34,307 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=848a3a18cbe98cc320d08ba07b8ba96b-e9b297cd62fb4ffe93c58c295f6bcb85 2023-02-12 12:03:34,307 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:34,308 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=848a3a18cbe98cc320d08ba07b8ba96b-5700c205c94e459cb7f097baefd118b5 2023-02-12 12:03:34,308 DEBUG [Listener at localhost/37189] util.CommonFSUtils(699): |----------8ae2df7fdfcc94c13f03c30905c97afe/ 2023-02-12 12:03:34,308 DEBUG [Listener at localhost/37189] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:34,311 INFO [Listener at localhost/37189] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 12:03:34,842 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,842 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:34,844 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:34,846 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:34,847 DEBUG [StoreOpener-08d929761de87e16486cc6686e3347af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/f1 2023-02-12 12:03:34,847 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08d929761de87e16486cc6686e3347af columnFamilyName f1 2023-02-12 12:03:34,848 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] regionserver.HStore(310): Store=08d929761de87e16486cc6686e3347af/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,848 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:34,849 DEBUG [StoreOpener-08d929761de87e16486cc6686e3347af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/f2 2023-02-12 12:03:34,849 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08d929761de87e16486cc6686e3347af columnFamilyName f2 2023-02-12 12:03:34,850 INFO [StoreOpener-08d929761de87e16486cc6686e3347af-1] regionserver.HStore(310): Store=08d929761de87e16486cc6686e3347af/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,850 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:34,850 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 08d929761de87e16486cc6686e3347af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74067926, jitterRate=0.10369810461997986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:34,850 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 08d929761de87e16486cc6686e3347af: Writing region info on filesystem at 1676203414844Initializing all the Stores at 1676203414845 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414845Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414845Region opened successfully at 1676203414850 (+5 ms) 2023-02-12 12:03:34,850 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 08d929761de87e16486cc6686e3347af, disabling compactions & flushes 2023-02-12 12:03:34,850 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:34,850 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:34,850 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. after waiting 0 ms 2023-02-12 12:03:34,850 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:34,851 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:34,851 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 08d929761de87e16486cc6686e3347af: Waiting for close lock at 1676203414850Disabling compacts and flushes for region at 1676203414850Disabling writes for close at 1676203414850Writing region close event to WAL at 1676203414851 (+1 ms)Closed at 1676203414851 2023-02-12 12:03:34,851 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,851 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:34,853 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:34,854 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:34,855 DEBUG [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1 2023-02-12 12:03:34,855 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ee046517bff49ca9065bc171bb2e44b columnFamilyName f1 2023-02-12 12:03:34,860 DEBUG [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/testWithMockedMapReduceMultiRegion=2ee046517bff49ca9065bc171bb2e44b-ac8d08693b704224bfcfe609ae5eac02 2023-02-12 12:03:34,860 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(310): Store=2ee046517bff49ca9065bc171bb2e44b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,860 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:34,861 DEBUG [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2 2023-02-12 12:03:34,861 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ee046517bff49ca9065bc171bb2e44b columnFamilyName f2 2023-02-12 12:03:34,865 DEBUG [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/testWithMockedMapReduceMultiRegion=2ee046517bff49ca9065bc171bb2e44b-8e4e86903cb44f0dbadd1d73395b1d69 2023-02-12 12:03:34,865 INFO [StoreOpener-2ee046517bff49ca9065bc171bb2e44b-1] regionserver.HStore(310): Store=2ee046517bff49ca9065bc171bb2e44b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,866 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:34,866 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 2ee046517bff49ca9065bc171bb2e44b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72568079, jitterRate=0.08134864270687103}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:34,866 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 2ee046517bff49ca9065bc171bb2e44b: Writing region info on filesystem at 1676203414853Initializing all the Stores at 1676203414853Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414853Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414853Region opened successfully at 1676203414866 (+13 ms) 2023-02-12 12:03:34,879 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 2ee046517bff49ca9065bc171bb2e44b, disabling compactions & flushes 2023-02-12 12:03:34,880 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:34,881 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:34,881 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. after waiting 0 ms 2023-02-12 12:03:34,881 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:34,885 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:34,885 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 2ee046517bff49ca9065bc171bb2e44b: Waiting for close lock at 1676203414879Disabling compacts and flushes for region at 1676203414879Disabling writes for close at 1676203414881 (+2 ms)Writing region close event to WAL at 1676203414885 (+4 ms)Closed at 1676203414885 2023-02-12 12:03:34,885 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,885 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:34,887 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:34,889 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:34,890 DEBUG [StoreOpener-2c3130a9983348c23f864030241d7275-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1 2023-02-12 12:03:34,890 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c3130a9983348c23f864030241d7275 columnFamilyName f1 2023-02-12 12:03:34,895 DEBUG [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/testWithMockedMapReduceMultiRegion=2c3130a9983348c23f864030241d7275-997d03dbea4549919da412ddc0e975b8 2023-02-12 12:03:34,895 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(310): Store=2c3130a9983348c23f864030241d7275/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,895 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:34,896 DEBUG [StoreOpener-2c3130a9983348c23f864030241d7275-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2 2023-02-12 12:03:34,897 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c3130a9983348c23f864030241d7275 columnFamilyName f2 2023-02-12 12:03:34,900 DEBUG [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/testWithMockedMapReduceMultiRegion=2c3130a9983348c23f864030241d7275-a32610ebb6c445e287ec030b48cb8d99 2023-02-12 12:03:34,900 INFO [StoreOpener-2c3130a9983348c23f864030241d7275-1] regionserver.HStore(310): Store=2c3130a9983348c23f864030241d7275/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,900 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:34,901 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 2c3130a9983348c23f864030241d7275; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74682287, jitterRate=0.1128527969121933}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:34,901 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 2c3130a9983348c23f864030241d7275: Writing region info on filesystem at 1676203414887Initializing all the Stores at 1676203414888 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414888Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414888Region opened successfully at 1676203414901 (+13 ms) 2023-02-12 12:03:34,909 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 2c3130a9983348c23f864030241d7275, disabling compactions & flushes 2023-02-12 12:03:34,909 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:34,909 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:34,909 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. after waiting 0 ms 2023-02-12 12:03:34,909 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:34,910 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:34,910 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 2c3130a9983348c23f864030241d7275: Waiting for close lock at 1676203414909Disabling compacts and flushes for region at 1676203414909Disabling writes for close at 1676203414909Writing region close event to WAL at 1676203414910 (+1 ms)Closed at 1676203414910 2023-02-12 12:03:34,910 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,910 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:34,912 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:34,917 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:34,917 DEBUG [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1 2023-02-12 12:03:34,918 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1741f347554acb33c94d7a04a06b5759 columnFamilyName f1 2023-02-12 12:03:34,922 DEBUG [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/testWithMockedMapReduceMultiRegion=1741f347554acb33c94d7a04a06b5759-c9ac967a19cc46f2b28c158586bde644 2023-02-12 12:03:34,922 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(310): Store=1741f347554acb33c94d7a04a06b5759/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,922 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:34,923 DEBUG [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2 2023-02-12 12:03:34,923 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1741f347554acb33c94d7a04a06b5759 columnFamilyName f2 2023-02-12 12:03:34,927 DEBUG [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/testWithMockedMapReduceMultiRegion=1741f347554acb33c94d7a04a06b5759-6f90ba4c71bb4199b2ba794b2eab3a1d 2023-02-12 12:03:34,927 INFO [StoreOpener-1741f347554acb33c94d7a04a06b5759-1] regionserver.HStore(310): Store=1741f347554acb33c94d7a04a06b5759/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,927 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:34,927 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 1741f347554acb33c94d7a04a06b5759; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71673587, jitterRate=0.06801967322826385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:34,927 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 1741f347554acb33c94d7a04a06b5759: Writing region info on filesystem at 1676203414912Initializing all the Stores at 1676203414913 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414913Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414916 (+3 ms)Region opened successfully at 1676203414927 (+11 ms) 2023-02-12 12:03:34,937 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 1741f347554acb33c94d7a04a06b5759, disabling compactions & flushes 2023-02-12 12:03:34,938 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:34,938 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:34,938 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. after waiting 0 ms 2023-02-12 12:03:34,938 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:34,938 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:34,938 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 1741f347554acb33c94d7a04a06b5759: Waiting for close lock at 1676203414937Disabling compacts and flushes for region at 1676203414937Disabling writes for close at 1676203414938 (+1 ms)Writing region close event to WAL at 1676203414938Closed at 1676203414938 2023-02-12 12:03:34,939 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,939 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:34,941 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:34,943 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:34,943 DEBUG [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1 2023-02-12 12:03:34,944 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b4accc0c33226ffa7fd5dc4aa27cdc6 columnFamilyName f1 2023-02-12 12:03:34,947 DEBUG [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/testWithMockedMapReduceMultiRegion=0b4accc0c33226ffa7fd5dc4aa27cdc6-05c108801017462dbbc765f2c5fb7dcf 2023-02-12 12:03:34,947 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(310): Store=0b4accc0c33226ffa7fd5dc4aa27cdc6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,948 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:34,948 DEBUG [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2 2023-02-12 12:03:34,949 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b4accc0c33226ffa7fd5dc4aa27cdc6 columnFamilyName f2 2023-02-12 12:03:34,955 DEBUG [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/testWithMockedMapReduceMultiRegion=0b4accc0c33226ffa7fd5dc4aa27cdc6-91e53aa8d65348b3bab459f5dc06cd03 2023-02-12 12:03:34,955 INFO [StoreOpener-0b4accc0c33226ffa7fd5dc4aa27cdc6-1] regionserver.HStore(310): Store=0b4accc0c33226ffa7fd5dc4aa27cdc6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,955 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:34,955 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 0b4accc0c33226ffa7fd5dc4aa27cdc6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67436752, jitterRate=0.00488591194152832}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:34,955 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 0b4accc0c33226ffa7fd5dc4aa27cdc6: Writing region info on filesystem at 1676203414941Initializing all the Stores at 1676203414942 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414942Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414942Region opened successfully at 1676203414955 (+13 ms) 2023-02-12 12:03:34,969 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 0b4accc0c33226ffa7fd5dc4aa27cdc6, disabling compactions & flushes 2023-02-12 12:03:34,970 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:34,970 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:34,970 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. after waiting 0 ms 2023-02-12 12:03:34,970 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:34,971 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:34,971 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 0b4accc0c33226ffa7fd5dc4aa27cdc6: Waiting for close lock at 1676203414969Disabling compacts and flushes for region at 1676203414969Disabling writes for close at 1676203414970 (+1 ms)Writing region close event to WAL at 1676203414971 (+1 ms)Closed at 1676203414971 2023-02-12 12:03:34,971 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,971 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:34,973 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:34,975 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:34,976 DEBUG [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1 2023-02-12 12:03:34,976 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 351ecbb77474c77ceb24de58cb2ad7ca columnFamilyName f1 2023-02-12 12:03:34,980 DEBUG [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/testWithMockedMapReduceMultiRegion=351ecbb77474c77ceb24de58cb2ad7ca-5fb36466f60e47a0a293100c4e4e87e9 2023-02-12 12:03:34,980 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(310): Store=351ecbb77474c77ceb24de58cb2ad7ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,980 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:34,981 DEBUG [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2 2023-02-12 12:03:34,981 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 351ecbb77474c77ceb24de58cb2ad7ca columnFamilyName f2 2023-02-12 12:03:34,985 DEBUG [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/testWithMockedMapReduceMultiRegion=351ecbb77474c77ceb24de58cb2ad7ca-8271070620704809987a404dc23c96c2 2023-02-12 12:03:34,985 INFO [StoreOpener-351ecbb77474c77ceb24de58cb2ad7ca-1] regionserver.HStore(310): Store=351ecbb77474c77ceb24de58cb2ad7ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:34,986 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:34,986 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 351ecbb77474c77ceb24de58cb2ad7ca; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67548198, jitterRate=0.006546586751937866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:34,986 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 351ecbb77474c77ceb24de58cb2ad7ca: Writing region info on filesystem at 1676203414973Initializing all the Stores at 1676203414974 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414974Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414974Region opened successfully at 1676203414986 (+12 ms) 2023-02-12 12:03:34,994 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 351ecbb77474c77ceb24de58cb2ad7ca, disabling compactions & flushes 2023-02-12 12:03:34,994 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:34,994 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:34,994 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. after waiting 0 ms 2023-02-12 12:03:34,994 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:34,995 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:34,995 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 351ecbb77474c77ceb24de58cb2ad7ca: Waiting for close lock at 1676203414994Disabling compacts and flushes for region at 1676203414994Disabling writes for close at 1676203414994Writing region close event to WAL at 1676203414995 (+1 ms)Closed at 1676203414995 2023-02-12 12:03:34,995 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:34,996 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:34,997 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:34,999 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:35,000 DEBUG [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/f1 2023-02-12 12:03:35,001 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ae2df7fdfcc94c13f03c30905c97afe columnFamilyName f1 2023-02-12 12:03:35,001 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] regionserver.HStore(310): Store=8ae2df7fdfcc94c13f03c30905c97afe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:35,001 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:35,002 DEBUG [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/f2 2023-02-12 12:03:35,002 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ae2df7fdfcc94c13f03c30905c97afe columnFamilyName f2 2023-02-12 12:03:35,003 INFO [StoreOpener-8ae2df7fdfcc94c13f03c30905c97afe-1] regionserver.HStore(310): Store=8ae2df7fdfcc94c13f03c30905c97afe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:35,003 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:35,003 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 8ae2df7fdfcc94c13f03c30905c97afe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64408910, jitterRate=-0.040232449769973755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:35,003 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 8ae2df7fdfcc94c13f03c30905c97afe: Writing region info on filesystem at 1676203414997Initializing all the Stores at 1676203414998 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414998Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203414998Region opened successfully at 1676203415003 (+5 ms) 2023-02-12 12:03:35,004 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 8ae2df7fdfcc94c13f03c30905c97afe, disabling compactions & flushes 2023-02-12 12:03:35,004 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:35,004 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:35,004 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. after waiting 0 ms 2023-02-12 12:03:35,004 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:35,004 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:35,004 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 8ae2df7fdfcc94c13f03c30905c97afe: Waiting for close lock at 1676203415004Disabling compacts and flushes for region at 1676203415004Disabling writes for close at 1676203415004Writing region close event to WAL at 1676203415004Closed at 1676203415004 2023-02-12 12:03:35,005 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:35,005 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:35,009 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:35,011 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:35,011 DEBUG [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1 2023-02-12 12:03:35,012 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c10d8776c481f0b5ffdcfbe99a6d164 columnFamilyName f1 2023-02-12 12:03:35,016 DEBUG [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/testWithMockedMapReduceMultiRegion=2c10d8776c481f0b5ffdcfbe99a6d164-e7d886b4c9c74eaea8fc70d0abeff332 2023-02-12 12:03:35,016 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(310): Store=2c10d8776c481f0b5ffdcfbe99a6d164/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:35,017 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:35,017 DEBUG [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2 2023-02-12 12:03:35,018 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c10d8776c481f0b5ffdcfbe99a6d164 columnFamilyName f2 2023-02-12 12:03:35,023 DEBUG [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/testWithMockedMapReduceMultiRegion=2c10d8776c481f0b5ffdcfbe99a6d164-30a821b2a5594a26b067d45a0c7304eb 2023-02-12 12:03:35,023 INFO [StoreOpener-2c10d8776c481f0b5ffdcfbe99a6d164-1] regionserver.HStore(310): Store=2c10d8776c481f0b5ffdcfbe99a6d164/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:35,023 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:35,023 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 2c10d8776c481f0b5ffdcfbe99a6d164; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73063226, jitterRate=0.08872690796852112}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:35,023 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 2c10d8776c481f0b5ffdcfbe99a6d164: Writing region info on filesystem at 1676203415009Initializing all the Stores at 1676203415010 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203415010Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203415010Region opened successfully at 1676203415023 (+13 ms) 2023-02-12 12:03:35,032 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 2c10d8776c481f0b5ffdcfbe99a6d164, disabling compactions & flushes 2023-02-12 12:03:35,032 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:35,032 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:35,032 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. after waiting 0 ms 2023-02-12 12:03:35,032 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:35,033 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:35,033 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 2c10d8776c481f0b5ffdcfbe99a6d164: Waiting for close lock at 1676203415032Disabling compacts and flushes for region at 1676203415032Disabling writes for close at 1676203415032Writing region close event to WAL at 1676203415033 (+1 ms)Closed at 1676203415033 2023-02-12 12:03:35,033 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:35,033 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:35,037 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:35,041 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:35,042 DEBUG [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1 2023-02-12 12:03:35,042 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e2e3201329af15e3eef03df24f2bddf columnFamilyName f1 2023-02-12 12:03:35,047 DEBUG [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/testWithMockedMapReduceMultiRegion=6e2e3201329af15e3eef03df24f2bddf-4284ad9d63124d4d88500ddc974d7ccd 2023-02-12 12:03:35,047 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(310): Store=6e2e3201329af15e3eef03df24f2bddf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:35,047 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:35,048 DEBUG [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2 2023-02-12 12:03:35,048 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e2e3201329af15e3eef03df24f2bddf columnFamilyName f2 2023-02-12 12:03:35,052 DEBUG [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/testWithMockedMapReduceMultiRegion=6e2e3201329af15e3eef03df24f2bddf-08e58ef2b1b241ed9d12e55312fa5904 2023-02-12 12:03:35,052 INFO [StoreOpener-6e2e3201329af15e3eef03df24f2bddf-1] regionserver.HStore(310): Store=6e2e3201329af15e3eef03df24f2bddf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:35,053 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:35,053 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 6e2e3201329af15e3eef03df24f2bddf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60437985, jitterRate=-0.09940384328365326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:35,053 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 6e2e3201329af15e3eef03df24f2bddf: Writing region info on filesystem at 1676203415037Initializing all the Stores at 1676203415038 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203415038Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203415040 (+2 ms)Region opened successfully at 1676203415053 (+13 ms) 2023-02-12 12:03:35,061 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 6e2e3201329af15e3eef03df24f2bddf, disabling compactions & flushes 2023-02-12 12:03:35,061 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:35,061 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:35,061 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. after waiting 0 ms 2023-02-12 12:03:35,061 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:35,062 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:35,062 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 6e2e3201329af15e3eef03df24f2bddf: Waiting for close lock at 1676203415061Disabling compacts and flushes for region at 1676203415061Disabling writes for close at 1676203415061Writing region close event to WAL at 1676203415062 (+1 ms)Closed at 1676203415062 2023-02-12 12:03:35,062 DEBUG [Listener at localhost/37189] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:35,062 INFO [Listener at localhost/37189] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:35,064 DEBUG [Listener at localhost/37189] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:35,066 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:35,067 DEBUG [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1 2023-02-12 12:03:35,067 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 848a3a18cbe98cc320d08ba07b8ba96b columnFamilyName f1 2023-02-12 12:03:35,071 DEBUG [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/testWithMockedMapReduceMultiRegion=848a3a18cbe98cc320d08ba07b8ba96b-e9b297cd62fb4ffe93c58c295f6bcb85 2023-02-12 12:03:35,071 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(310): Store=848a3a18cbe98cc320d08ba07b8ba96b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:35,071 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:35,072 DEBUG [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2 2023-02-12 12:03:35,072 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 848a3a18cbe98cc320d08ba07b8ba96b columnFamilyName f2 2023-02-12 12:03:35,075 DEBUG [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(539): loaded hdfs://localhost:38993/user/jenkins/test-data/9c49e0c8-5b6b-1050-1060-d43ed83e7242/testWithMockedMapReduceMultiRegion/d2a6c564-0b0d-4b44-8a9e-052c6c2d8f12/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/testWithMockedMapReduceMultiRegion=848a3a18cbe98cc320d08ba07b8ba96b-5700c205c94e459cb7f097baefd118b5 2023-02-12 12:03:35,075 INFO [StoreOpener-848a3a18cbe98cc320d08ba07b8ba96b-1] regionserver.HStore(310): Store=848a3a18cbe98cc320d08ba07b8ba96b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:35,076 DEBUG [Listener at localhost/37189] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:35,076 INFO [Listener at localhost/37189] regionserver.HRegion(1071): Opened 848a3a18cbe98cc320d08ba07b8ba96b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62987806, jitterRate=-0.061408549547195435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:35,076 DEBUG [Listener at localhost/37189] regionserver.HRegion(964): Region open journal for 848a3a18cbe98cc320d08ba07b8ba96b: Writing region info on filesystem at 1676203415064Initializing all the Stores at 1676203415065 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203415065Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203415065Region opened successfully at 1676203415076 (+11 ms) 2023-02-12 12:03:35,084 DEBUG [Listener at localhost/37189] regionserver.HRegion(1603): Closing 848a3a18cbe98cc320d08ba07b8ba96b, disabling compactions & flushes 2023-02-12 12:03:35,084 INFO [Listener at localhost/37189] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:35,084 DEBUG [Listener at localhost/37189] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:35,084 DEBUG [Listener at localhost/37189] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. after waiting 0 ms 2023-02-12 12:03:35,084 DEBUG [Listener at localhost/37189] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:35,084 INFO [Listener at localhost/37189] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:35,085 DEBUG [Listener at localhost/37189] regionserver.HRegion(1557): Region close journal for 848a3a18cbe98cc320d08ba07b8ba96b: Waiting for close lock at 1676203415084Disabling compacts and flushes for region at 1676203415084Disabling writes for close at 1676203415084Writing region close event to WAL at 1676203415084Closed at 1676203415084 2023-02-12 12:03:35,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-12 12:03:35,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,092 INFO [Listener at localhost/37189] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,096 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203415095"}]},"ts":"1676203415095"} 2023-02-12 12:03:35,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 12:03:35,097 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-12 12:03:35,100 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-12 12:03:35,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08d929761de87e16486cc6686e3347af, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1741f347554acb33c94d7a04a06b5759, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=848a3a18cbe98cc320d08ba07b8ba96b, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c10d8776c481f0b5ffdcfbe99a6d164, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c3130a9983348c23f864030241d7275, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=351ecbb77474c77ceb24de58cb2ad7ca, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e2e3201329af15e3eef03df24f2bddf, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ee046517bff49ca9065bc171bb2e44b, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b4accc0c33226ffa7fd5dc4aa27cdc6, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ae2df7fdfcc94c13f03c30905c97afe, UNASSIGN}] 2023-02-12 12:03:35,102 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=848a3a18cbe98cc320d08ba07b8ba96b, UNASSIGN 2023-02-12 12:03:35,103 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c10d8776c481f0b5ffdcfbe99a6d164, UNASSIGN 2023-02-12 12:03:35,103 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1741f347554acb33c94d7a04a06b5759, UNASSIGN 2023-02-12 12:03:35,103 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08d929761de87e16486cc6686e3347af, UNASSIGN 2023-02-12 12:03:35,103 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ae2df7fdfcc94c13f03c30905c97afe, UNASSIGN 2023-02-12 12:03:35,103 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=848a3a18cbe98cc320d08ba07b8ba96b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:35,103 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2c10d8776c481f0b5ffdcfbe99a6d164, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:35,103 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415103"}]},"ts":"1676203415103"} 2023-02-12 12:03:35,103 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1741f347554acb33c94d7a04a06b5759, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:35,103 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=08d929761de87e16486cc6686e3347af, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:35,104 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415103"}]},"ts":"1676203415103"} 2023-02-12 12:03:35,104 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8ae2df7fdfcc94c13f03c30905c97afe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:35,103 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415103"}]},"ts":"1676203415103"} 2023-02-12 12:03:35,104 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203415103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415103"}]},"ts":"1676203415103"} 2023-02-12 12:03:35,104 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203415103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415103"}]},"ts":"1676203415103"} 2023-02-12 12:03:35,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure 848a3a18cbe98cc320d08ba07b8ba96b, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:35,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure 1741f347554acb33c94d7a04a06b5759, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:35,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 2c10d8776c481f0b5ffdcfbe99a6d164, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:35,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 8ae2df7fdfcc94c13f03c30905c97afe, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:35,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=34, state=RUNNABLE; CloseRegionProcedure 08d929761de87e16486cc6686e3347af, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:35,107 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b4accc0c33226ffa7fd5dc4aa27cdc6, UNASSIGN 2023-02-12 12:03:35,108 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ee046517bff49ca9065bc171bb2e44b, UNASSIGN 2023-02-12 12:03:35,108 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=0b4accc0c33226ffa7fd5dc4aa27cdc6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:35,108 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415108"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415108"}]},"ts":"1676203415108"} 2023-02-12 12:03:35,108 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e2e3201329af15e3eef03df24f2bddf, UNASSIGN 2023-02-12 12:03:35,108 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=2ee046517bff49ca9065bc171bb2e44b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:35,109 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415108"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415108"}]},"ts":"1676203415108"} 2023-02-12 12:03:35,109 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=351ecbb77474c77ceb24de58cb2ad7ca, UNASSIGN 2023-02-12 12:03:35,109 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6e2e3201329af15e3eef03df24f2bddf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:35,109 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415109"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415109"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415109"}]},"ts":"1676203415109"} 2023-02-12 12:03:35,109 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=351ecbb77474c77ceb24de58cb2ad7ca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:35,109 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415109"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415109"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415109"}]},"ts":"1676203415109"} 2023-02-12 12:03:35,110 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c3130a9983348c23f864030241d7275, UNASSIGN 2023-02-12 12:03:35,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 0b4accc0c33226ffa7fd5dc4aa27cdc6, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:35,110 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2c3130a9983348c23f864030241d7275, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:35,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 2ee046517bff49ca9065bc171bb2e44b, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:35,110 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676203411798.2c3130a9983348c23f864030241d7275.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415110"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203415110"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203415110"}]},"ts":"1676203415110"} 2023-02-12 12:03:35,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 6e2e3201329af15e3eef03df24f2bddf, server=jenkins-hbase4.apache.org,44631,1676203410150}] 2023-02-12 12:03:35,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 351ecbb77474c77ceb24de58cb2ad7ca, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:35,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure 2c3130a9983348c23f864030241d7275, server=jenkins-hbase4.apache.org,38457,1676203410122}] 2023-02-12 12:03:35,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 12:03:35,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:35,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6e2e3201329af15e3eef03df24f2bddf, disabling compactions & flushes 2023-02-12 12:03:35,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:35,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:35,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. after waiting 0 ms 2023-02-12 12:03:35,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:35,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:35,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2ee046517bff49ca9065bc171bb2e44b, disabling compactions & flushes 2023-02-12 12:03:35,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:35,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:35,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. after waiting 0 ms 2023-02-12 12:03:35,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:35,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:35,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf. 2023-02-12 12:03:35,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6e2e3201329af15e3eef03df24f2bddf: Waiting for close lock at 1676203415257Running coprocessor pre-close hooks at 1676203415257Disabling compacts and flushes for region at 1676203415257Disabling writes for close at 1676203415257Writing region close event to WAL at 1676203415258 (+1 ms)Running coprocessor post-close hooks at 1676203415262 (+4 ms)Closed at 1676203415262 2023-02-12 12:03:35,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:35,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b. 2023-02-12 12:03:35,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2ee046517bff49ca9065bc171bb2e44b: Waiting for close lock at 1676203415259Running coprocessor pre-close hooks at 1676203415259Disabling compacts and flushes for region at 1676203415259Disabling writes for close at 1676203415259Writing region close event to WAL at 1676203415260 (+1 ms)Running coprocessor post-close hooks at 1676203415263 (+3 ms)Closed at 1676203415263 2023-02-12 12:03:35,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:35,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:35,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0b4accc0c33226ffa7fd5dc4aa27cdc6, disabling compactions & flushes 2023-02-12 12:03:35,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:35,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:35,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. after waiting 0 ms 2023-02-12 12:03:35,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:35,264 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6e2e3201329af15e3eef03df24f2bddf, regionState=CLOSED 2023-02-12 12:03:35,264 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415264"}]},"ts":"1676203415264"} 2023-02-12 12:03:35,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:35,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:35,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 351ecbb77474c77ceb24de58cb2ad7ca, disabling compactions & flushes 2023-02-12 12:03:35,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:35,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:35,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. after waiting 0 ms 2023-02-12 12:03:35,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:35,265 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=2ee046517bff49ca9065bc171bb2e44b, regionState=CLOSED 2023-02-12 12:03:35,265 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415265"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415265"}]},"ts":"1676203415265"} 2023-02-12 12:03:35,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-12 12:03:35,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 6e2e3201329af15e3eef03df24f2bddf, server=jenkins-hbase4.apache.org,44631,1676203410150 in 154 msec 2023-02-12 12:03:35,267 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-12 12:03:35,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 2ee046517bff49ca9065bc171bb2e44b, server=jenkins-hbase4.apache.org,38457,1676203410122 in 156 msec 2023-02-12 12:03:35,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6e2e3201329af15e3eef03df24f2bddf, UNASSIGN in 167 msec 2023-02-12 12:03:35,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2ee046517bff49ca9065bc171bb2e44b, UNASSIGN in 168 msec 2023-02-12 12:03:35,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:35,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6. 2023-02-12 12:03:35,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0b4accc0c33226ffa7fd5dc4aa27cdc6: Waiting for close lock at 1676203415263Running coprocessor pre-close hooks at 1676203415263Disabling compacts and flushes for region at 1676203415263Disabling writes for close at 1676203415264 (+1 ms)Writing region close event to WAL at 1676203415268 (+4 ms)Running coprocessor post-close hooks at 1676203415271 (+3 ms)Closed at 1676203415271 2023-02-12 12:03:35,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:35,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:35,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1741f347554acb33c94d7a04a06b5759, disabling compactions & flushes 2023-02-12 12:03:35,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:35,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:35,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. after waiting 0 ms 2023-02-12 12:03:35,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:35,273 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=0b4accc0c33226ffa7fd5dc4aa27cdc6, regionState=CLOSED 2023-02-12 12:03:35,273 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415273"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415273"}]},"ts":"1676203415273"} 2023-02-12 12:03:35,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-12 12:03:35,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 0b4accc0c33226ffa7fd5dc4aa27cdc6, server=jenkins-hbase4.apache.org,44631,1676203410150 in 164 msec 2023-02-12 12:03:35,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0b4accc0c33226ffa7fd5dc4aa27cdc6, UNASSIGN in 175 msec 2023-02-12 12:03:35,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:35,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca. 2023-02-12 12:03:35,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 351ecbb77474c77ceb24de58cb2ad7ca: Waiting for close lock at 1676203415264Running coprocessor pre-close hooks at 1676203415264Disabling compacts and flushes for region at 1676203415264Disabling writes for close at 1676203415264Writing region close event to WAL at 1676203415265 (+1 ms)Running coprocessor post-close hooks at 1676203415277 (+12 ms)Closed at 1676203415277 2023-02-12 12:03:35,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:35,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:35,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2c3130a9983348c23f864030241d7275, disabling compactions & flushes 2023-02-12 12:03:35,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:35,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:35,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. after waiting 0 ms 2023-02-12 12:03:35,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:35,279 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=351ecbb77474c77ceb24de58cb2ad7ca, regionState=CLOSED 2023-02-12 12:03:35,279 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415279"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415279"}]},"ts":"1676203415279"} 2023-02-12 12:03:35,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:35,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759. 2023-02-12 12:03:35,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1741f347554acb33c94d7a04a06b5759: Waiting for close lock at 1676203415272Running coprocessor pre-close hooks at 1676203415272Disabling compacts and flushes for region at 1676203415272Disabling writes for close at 1676203415273 (+1 ms)Writing region close event to WAL at 1676203415277 (+4 ms)Running coprocessor post-close hooks at 1676203415281 (+4 ms)Closed at 1676203415281 2023-02-12 12:03:35,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:35,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:35,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2c10d8776c481f0b5ffdcfbe99a6d164, disabling compactions & flushes 2023-02-12 12:03:35,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:35,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:35,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. after waiting 0 ms 2023-02-12 12:03:35,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:35,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-12 12:03:35,282 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1741f347554acb33c94d7a04a06b5759, regionState=CLOSED 2023-02-12 12:03:35,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 351ecbb77474c77ceb24de58cb2ad7ca, server=jenkins-hbase4.apache.org,38457,1676203410122 in 168 msec 2023-02-12 12:03:35,283 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415282"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415282"}]},"ts":"1676203415282"} 2023-02-12 12:03:35,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=351ecbb77474c77ceb24de58cb2ad7ca, UNASSIGN in 182 msec 2023-02-12 12:03:35,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:35,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275. 2023-02-12 12:03:35,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2c3130a9983348c23f864030241d7275: Waiting for close lock at 1676203415279Running coprocessor pre-close hooks at 1676203415279Disabling compacts and flushes for region at 1676203415279Disabling writes for close at 1676203415279Writing region close event to WAL at 1676203415281 (+2 ms)Running coprocessor post-close hooks at 1676203415285 (+4 ms)Closed at 1676203415285 2023-02-12 12:03:35,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-12 12:03:35,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure 1741f347554acb33c94d7a04a06b5759, server=jenkins-hbase4.apache.org,44631,1676203410150 in 179 msec 2023-02-12 12:03:35,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2c3130a9983348c23f864030241d7275 2023-02-12 12:03:35,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:35,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:35,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08d929761de87e16486cc6686e3347af, disabling compactions & flushes 2023-02-12 12:03:35,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:35,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:35,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. after waiting 0 ms 2023-02-12 12:03:35,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:35,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164. 2023-02-12 12:03:35,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2c10d8776c481f0b5ffdcfbe99a6d164: Waiting for close lock at 1676203415282Running coprocessor pre-close hooks at 1676203415282Disabling compacts and flushes for region at 1676203415282Disabling writes for close at 1676203415282Writing region close event to WAL at 1676203415283 (+1 ms)Running coprocessor post-close hooks at 1676203415287 (+4 ms)Closed at 1676203415287 2023-02-12 12:03:35,288 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1741f347554acb33c94d7a04a06b5759, UNASSIGN in 186 msec 2023-02-12 12:03:35,288 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2c3130a9983348c23f864030241d7275, regionState=CLOSED 2023-02-12 12:03:35,288 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676203411798.2c3130a9983348c23f864030241d7275.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415288"}]},"ts":"1676203415288"} 2023-02-12 12:03:35,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:35,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:35,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 848a3a18cbe98cc320d08ba07b8ba96b, disabling compactions & flushes 2023-02-12 12:03:35,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:35,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:35,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. after waiting 0 ms 2023-02-12 12:03:35,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:35,289 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2c10d8776c481f0b5ffdcfbe99a6d164, regionState=CLOSED 2023-02-12 12:03:35,289 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415289"}]},"ts":"1676203415289"} 2023-02-12 12:03:35,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 12:03:35,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af. 2023-02-12 12:03:35,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08d929761de87e16486cc6686e3347af: Waiting for close lock at 1676203415287Running coprocessor pre-close hooks at 1676203415287Disabling compacts and flushes for region at 1676203415287Disabling writes for close at 1676203415287Writing region close event to WAL at 1676203415287Running coprocessor post-close hooks at 1676203415290 (+3 ms)Closed at 1676203415290 2023-02-12 12:03:35,291 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-12 12:03:35,291 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure 2c3130a9983348c23f864030241d7275, server=jenkins-hbase4.apache.org,38457,1676203410122 in 174 msec 2023-02-12 12:03:35,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 08d929761de87e16486cc6686e3347af 2023-02-12 12:03:35,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:35,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8ae2df7fdfcc94c13f03c30905c97afe, disabling compactions & flushes 2023-02-12 12:03:35,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:35,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:35,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. after waiting 0 ms 2023-02-12 12:03:35,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:35,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=08d929761de87e16486cc6686e3347af, regionState=CLOSED 2023-02-12 12:03:35,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-12 12:03:35,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203415292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415292"}]},"ts":"1676203415292"} 2023-02-12 12:03:35,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 2c10d8776c481f0b5ffdcfbe99a6d164, server=jenkins-hbase4.apache.org,44631,1676203410150 in 184 msec 2023-02-12 12:03:35,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c3130a9983348c23f864030241d7275, UNASSIGN in 191 msec 2023-02-12 12:03:35,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:35,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=2c10d8776c481f0b5ffdcfbe99a6d164, UNASSIGN in 192 msec 2023-02-12 12:03:35,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b. 2023-02-12 12:03:35,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 848a3a18cbe98cc320d08ba07b8ba96b: Waiting for close lock at 1676203415288Running coprocessor pre-close hooks at 1676203415288Disabling compacts and flushes for region at 1676203415288Disabling writes for close at 1676203415289 (+1 ms)Writing region close event to WAL at 1676203415290 (+1 ms)Running coprocessor post-close hooks at 1676203415295 (+5 ms)Closed at 1676203415295 2023-02-12 12:03:35,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=34 2023-02-12 12:03:35,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=34, state=SUCCESS; CloseRegionProcedure 08d929761de87e16486cc6686e3347af, server=jenkins-hbase4.apache.org,38457,1676203410122 in 187 msec 2023-02-12 12:03:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 12:03:35,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=08d929761de87e16486cc6686e3347af, UNASSIGN in 195 msec 2023-02-12 12:03:35,296 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=848a3a18cbe98cc320d08ba07b8ba96b, regionState=CLOSED 2023-02-12 12:03:35,296 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676203415296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415296"}]},"ts":"1676203415296"} 2023-02-12 12:03:35,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:35,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-12 12:03:35,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure 848a3a18cbe98cc320d08ba07b8ba96b, server=jenkins-hbase4.apache.org,44631,1676203410150 in 192 msec 2023-02-12 12:03:35,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=848a3a18cbe98cc320d08ba07b8ba96b, UNASSIGN in 198 msec 2023-02-12 12:03:35,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe. 2023-02-12 12:03:35,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8ae2df7fdfcc94c13f03c30905c97afe: Waiting for close lock at 1676203415292Running coprocessor pre-close hooks at 1676203415292Disabling compacts and flushes for region at 1676203415292Disabling writes for close at 1676203415292Writing region close event to WAL at 1676203415293 (+1 ms)Running coprocessor post-close hooks at 1676203415300 (+7 ms)Closed at 1676203415300 2023-02-12 12:03:35,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:35,301 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8ae2df7fdfcc94c13f03c30905c97afe, regionState=CLOSED 2023-02-12 12:03:35,301 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676203415301"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203415301"}]},"ts":"1676203415301"} 2023-02-12 12:03:35,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-12 12:03:35,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 8ae2df7fdfcc94c13f03c30905c97afe, server=jenkins-hbase4.apache.org,38457,1676203410122 in 196 msec 2023-02-12 12:03:35,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=33 2023-02-12 12:03:35,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8ae2df7fdfcc94c13f03c30905c97afe, UNASSIGN in 203 msec 2023-02-12 12:03:35,305 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203415305"}]},"ts":"1676203415305"} 2023-02-12 12:03:35,306 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-12 12:03:35,308 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-12 12:03:35,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 216 msec 2023-02-12 12:03:35,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 12:03:35,399 INFO [Listener at localhost/37189] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-12 12:03:35,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,402 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,403 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 12:03:35,412 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af 2023-02-12 12:03:35,412 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:35,412 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:35,412 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:35,412 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:35,412 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275 2023-02-12 12:03:35,412 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:35,412 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:35,416 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/recovered.edits] 2023-02-12 12:03:35,417 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/recovered.edits] 2023-02-12 12:03:35,417 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/recovered.edits] 2023-02-12 12:03:35,417 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/recovered.edits] 2023-02-12 12:03:35,417 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/recovered.edits] 2023-02-12 12:03:35,418 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/recovered.edits] 2023-02-12 12:03:35,418 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/recovered.edits] 2023-02-12 12:03:35,418 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/recovered.edits] 2023-02-12 12:03:35,424 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/7d8cf35fe1784f188e09a2542f2c8e05 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/7d8cf35fe1784f188e09a2542f2c8e05 2023-02-12 12:03:35,426 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/3569522581424d99ae462691cb332ea3 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/3569522581424d99ae462691cb332ea3 2023-02-12 12:03:35,427 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/2bd0566c992f45f8958842c5723c6876 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/2bd0566c992f45f8958842c5723c6876 2023-02-12 12:03:35,427 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/a8439974bf414ed4adb25c6c5536576e to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/a8439974bf414ed4adb25c6c5536576e 2023-02-12 12:03:35,428 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/997d03dbea4549919da412ddc0e975b8 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/997d03dbea4549919da412ddc0e975b8 2023-02-12 12:03:35,428 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/4284ad9d63124d4d88500ddc974d7ccd to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/4284ad9d63124d4d88500ddc974d7ccd 2023-02-12 12:03:35,428 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/c60313a90a5d48bb8e53fe809c6e56e2 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/c60313a90a5d48bb8e53fe809c6e56e2 2023-02-12 12:03:35,428 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/c9ac967a19cc46f2b28c158586bde644 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f1/c9ac967a19cc46f2b28c158586bde644 2023-02-12 12:03:35,430 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/e7d886b4c9c74eaea8fc70d0abeff332 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f1/e7d886b4c9c74eaea8fc70d0abeff332 2023-02-12 12:03:35,430 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/ac8d08693b704224bfcfe609ae5eac02 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f1/ac8d08693b704224bfcfe609ae5eac02 2023-02-12 12:03:35,431 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/5fb36466f60e47a0a293100c4e4e87e9 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f1/5fb36466f60e47a0a293100c4e4e87e9 2023-02-12 12:03:35,431 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/b532c42b8b44444992dc3177d343a873 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f1/b532c42b8b44444992dc3177d343a873 2023-02-12 12:03:35,431 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/e9b297cd62fb4ffe93c58c295f6bcb85 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f1/e9b297cd62fb4ffe93c58c295f6bcb85 2023-02-12 12:03:35,431 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/recovered.edits/6.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af/recovered.edits/6.seqid 2023-02-12 12:03:35,431 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/e5b7f9173acc4ed59bcbd1bd9dc5af90 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f1/e5b7f9173acc4ed59bcbd1bd9dc5af90 2023-02-12 12:03:35,432 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/08d929761de87e16486cc6686e3347af 2023-02-12 12:03:35,432 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:35,434 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/6f90ba4c71bb4199b2ba794b2eab3a1d to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/6f90ba4c71bb4199b2ba794b2eab3a1d 2023-02-12 12:03:35,435 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/7d8f819a33fb49398eeb5bb41077b1ea to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/f2/7d8f819a33fb49398eeb5bb41077b1ea 2023-02-12 12:03:35,436 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/30a821b2a5594a26b067d45a0c7304eb to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/30a821b2a5594a26b067d45a0c7304eb 2023-02-12 12:03:35,436 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/8271070620704809987a404dc23c96c2 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/8271070620704809987a404dc23c96c2 2023-02-12 12:03:35,436 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/recovered.edits] 2023-02-12 12:03:35,436 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/5700c205c94e459cb7f097baefd118b5 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/5700c205c94e459cb7f097baefd118b5 2023-02-12 12:03:35,437 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/a32610ebb6c445e287ec030b48cb8d99 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/a32610ebb6c445e287ec030b48cb8d99 2023-02-12 12:03:35,438 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/921fca19e1404e93b1c5cc1a934ba574 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/f2/921fca19e1404e93b1c5cc1a934ba574 2023-02-12 12:03:35,438 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/fdcf508a734b43b6896e93771b458be0 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/f2/fdcf508a734b43b6896e93771b458be0 2023-02-12 12:03:35,438 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/8e4e86903cb44f0dbadd1d73395b1d69 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/8e4e86903cb44f0dbadd1d73395b1d69 2023-02-12 12:03:35,438 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/c1bc326e3d454630a0a0d9b51cf777f2 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/f2/c1bc326e3d454630a0a0d9b51cf777f2 2023-02-12 12:03:35,438 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/08e58ef2b1b241ed9d12e55312fa5904 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/08e58ef2b1b241ed9d12e55312fa5904 2023-02-12 12:03:35,444 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/c687414d07234dd4b923a3619a224234 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/f2/c687414d07234dd4b923a3619a224234 2023-02-12 12:03:35,444 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/fc11ad4f3c5149c4a65eb0affebed81a to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/f2/fc11ad4f3c5149c4a65eb0affebed81a 2023-02-12 12:03:35,445 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/10c06396d05a476f999d280386e1eeae to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/f2/10c06396d05a476f999d280386e1eeae 2023-02-12 12:03:35,446 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/recovered.edits/12.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759/recovered.edits/12.seqid 2023-02-12 12:03:35,447 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/1741f347554acb33c94d7a04a06b5759 2023-02-12 12:03:35,447 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:35,448 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/05c108801017462dbbc765f2c5fb7dcf to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/05c108801017462dbbc765f2c5fb7dcf 2023-02-12 12:03:35,448 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/recovered.edits/12.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca/recovered.edits/12.seqid 2023-02-12 12:03:35,449 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/recovered.edits/12.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164/recovered.edits/12.seqid 2023-02-12 12:03:35,449 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/351ecbb77474c77ceb24de58cb2ad7ca 2023-02-12 12:03:35,450 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c10d8776c481f0b5ffdcfbe99a6d164 2023-02-12 12:03:35,450 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/recovered.edits/12.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b/recovered.edits/12.seqid 2023-02-12 12:03:35,451 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/f1, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/f2, FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/recovered.edits] 2023-02-12 12:03:35,451 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/848a3a18cbe98cc320d08ba07b8ba96b 2023-02-12 12:03:35,451 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/44d13609d1e545f28f87e828419ac541 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f1/44d13609d1e545f28f87e828419ac541 2023-02-12 12:03:35,451 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/recovered.edits/12.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b/recovered.edits/12.seqid 2023-02-12 12:03:35,452 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/recovered.edits/12.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275/recovered.edits/12.seqid 2023-02-12 12:03:35,452 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2ee046517bff49ca9065bc171bb2e44b 2023-02-12 12:03:35,452 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/2c3130a9983348c23f864030241d7275 2023-02-12 12:03:35,453 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/recovered.edits/12.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf/recovered.edits/12.seqid 2023-02-12 12:03:35,454 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/6e2e3201329af15e3eef03df24f2bddf 2023-02-12 12:03:35,455 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/547e060509a340f7ac8e7f10cc352dfa to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/547e060509a340f7ac8e7f10cc352dfa 2023-02-12 12:03:35,457 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/91e53aa8d65348b3bab459f5dc06cd03 to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/f2/91e53aa8d65348b3bab459f5dc06cd03 2023-02-12 12:03:35,458 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/recovered.edits/6.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe/recovered.edits/6.seqid 2023-02-12 12:03:35,459 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/8ae2df7fdfcc94c13f03c30905c97afe 2023-02-12 12:03:35,460 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/recovered.edits/12.seqid to hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/archive/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6/recovered.edits/12.seqid 2023-02-12 12:03:35,461 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/.tmp/data/default/testWithMockedMapReduceMultiRegion/0b4accc0c33226ffa7fd5dc4aa27cdc6 2023-02-12 12:03:35,461 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 12:03:35,463 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,466 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-12 12:03:35,468 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676203411798.2c3130a9983348c23f864030241d7275.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,469 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203415469"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,471 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 12:03:35,471 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 08d929761de87e16486cc6686e3347af, NAME => 'testWithMockedMapReduceMultiRegion,,1676203411798.08d929761de87e16486cc6686e3347af.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 1741f347554acb33c94d7a04a06b5759, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676203411798.1741f347554acb33c94d7a04a06b5759.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 848a3a18cbe98cc320d08ba07b8ba96b, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676203411798.848a3a18cbe98cc320d08ba07b8ba96b.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 2c10d8776c481f0b5ffdcfbe99a6d164, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676203411798.2c10d8776c481f0b5ffdcfbe99a6d164.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 2c3130a9983348c23f864030241d7275, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676203411798.2c3130a9983348c23f864030241d7275.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 351ecbb77474c77ceb24de58cb2ad7ca, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676203411798.351ecbb77474c77ceb24de58cb2ad7ca.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 6e2e3201329af15e3eef03df24f2bddf, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676203411798.6e2e3201329af15e3eef03df24f2bddf.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 2ee046517bff49ca9065bc171bb2e44b, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676203411798.2ee046517bff49ca9065bc171bb2e44b.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 0b4accc0c33226ffa7fd5dc4aa27cdc6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676203411798.0b4accc0c33226ffa7fd5dc4aa27cdc6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 8ae2df7fdfcc94c13f03c30905c97afe, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676203411798.8ae2df7fdfcc94c13f03c30905c97afe.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 12:03:35,471 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-12 12:03:35,471 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676203415471"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:35,472 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-12 12:03:35,474 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 12:03:35,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 74 msec 2023-02-12 12:03:35,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40569] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 12:03:35,504 INFO [Listener at localhost/37189] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-12 12:03:35,505 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 12:03:35,505 INFO [Listener at localhost/37189] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 12:03:35,505 DEBUG [Listener at localhost/37189] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a8375cd to 127.0.0.1:62383 2023-02-12 12:03:35,505 DEBUG [Listener at localhost/37189] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:35,505 DEBUG [Listener at localhost/37189] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 12:03:35,505 DEBUG [Listener at localhost/37189] util.JVMClusterUtil(257): Found active master hash=119805857, stopped=false 2023-02-12 12:03:35,505 INFO [Listener at localhost/37189] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:35,508 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:35,508 INFO [Listener at localhost/37189] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 12:03:35,508 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:35,508 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:35,508 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:35,510 DEBUG [Listener at localhost/37189] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e0f3d23 to 127.0.0.1:62383 2023-02-12 12:03:35,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:35,510 DEBUG [Listener at localhost/37189] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:35,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:35,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:35,510 INFO [Listener at localhost/37189] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38457,1676203410122' ***** 2023-02-12 12:03:35,510 INFO [Listener at localhost/37189] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:35,510 INFO [Listener at localhost/37189] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44631,1676203410150' ***** 2023-02-12 12:03:35,510 INFO [Listener at localhost/37189] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:35,511 INFO [RS:0;jenkins-hbase4:38457] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:35,511 INFO [RS:0;jenkins-hbase4:38457] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:35,511 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:35,511 INFO [RS:0;jenkins-hbase4:38457] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:35,512 INFO [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:35,512 DEBUG [RS:0;jenkins-hbase4:38457] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x288a9412 to 127.0.0.1:62383 2023-02-12 12:03:35,512 DEBUG [RS:0;jenkins-hbase4:38457] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:35,512 INFO [RS:0;jenkins-hbase4:38457] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:35,512 INFO [RS:0;jenkins-hbase4:38457] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:35,512 INFO [RS:0;jenkins-hbase4:38457] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:35,512 INFO [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 12:03:35,512 INFO [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 12:03:35,512 DEBUG [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 12:03:35,512 INFO [RS:1;jenkins-hbase4:44631] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:35,512 DEBUG [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:35,513 INFO [RS:1;jenkins-hbase4:44631] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:35,513 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:35,513 INFO [RS:1;jenkins-hbase4:44631] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:35,513 INFO [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(3304): Received CLOSE for 3165655d51baaffe01181da74487af25 2023-02-12 12:03:35,514 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:35,514 INFO [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:35,514 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:35,516 DEBUG [RS:1;jenkins-hbase4:44631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0981b851 to 127.0.0.1:62383 2023-02-12 12:03:35,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3165655d51baaffe01181da74487af25, disabling compactions & flushes 2023-02-12 12:03:35,516 DEBUG [RS:1;jenkins-hbase4:44631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:35,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:35,516 INFO [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 12:03:35,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:35,516 DEBUG [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1479): Online Regions={3165655d51baaffe01181da74487af25=hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25.} 2023-02-12 12:03:35,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:35,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:35,516 DEBUG [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1505): Waiting on 3165655d51baaffe01181da74487af25 2023-02-12 12:03:35,516 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:35,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. after waiting 0 ms 2023-02-12 12:03:35,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:35,516 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-12 12:03:35,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 3165655d51baaffe01181da74487af25 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 12:03:35,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25/.tmp/info/9085c5c269754d06b5dbab9bbcfee031 2023-02-12 12:03:35,530 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/.tmp/info/890a216a767743aa9239d7df2fa143d0 2023-02-12 12:03:35,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25/.tmp/info/9085c5c269754d06b5dbab9bbcfee031 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25/info/9085c5c269754d06b5dbab9bbcfee031 2023-02-12 12:03:35,533 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 890a216a767743aa9239d7df2fa143d0 2023-02-12 12:03:35,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25/info/9085c5c269754d06b5dbab9bbcfee031, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 12:03:35,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3165655d51baaffe01181da74487af25 in 21ms, sequenceid=6, compaction requested=false 2023-02-12 12:03:35,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/.tmp/rep_barrier/d4f348d74c7e4efa94e3052dd84b8c73 2023-02-12 12:03:35,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/namespace/3165655d51baaffe01181da74487af25/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 12:03:35,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:35,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3165655d51baaffe01181da74487af25: Waiting for close lock at 1676203415514Running coprocessor pre-close hooks at 1676203415514Disabling compacts and flushes for region at 1676203415514Disabling writes for close at 1676203415516 (+2 ms)Obtaining lock to block concurrent updates at 1676203415516Preparing flush snapshotting stores in 3165655d51baaffe01181da74487af25 at 1676203415516Finished memstore snapshotting hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676203415517 (+1 ms)Flushing stores of hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. at 1676203415517Flushing 3165655d51baaffe01181da74487af25/info: creating writer at 1676203415517Flushing 3165655d51baaffe01181da74487af25/info: appending metadata at 1676203415519 (+2 ms)Flushing 3165655d51baaffe01181da74487af25/info: closing flushed file at 1676203415519Flushing 3165655d51baaffe01181da74487af25/info: reopening flushed file at 1676203415533 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3165655d51baaffe01181da74487af25 in 21ms, sequenceid=6, compaction requested=false at 1676203415537 (+4 ms)Writing region close event to WAL at 1676203415538 (+1 ms)Running coprocessor post-close hooks at 1676203415542 (+4 ms)Closed at 1676203415542 2023-02-12 12:03:35,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676203411177.3165655d51baaffe01181da74487af25. 2023-02-12 12:03:35,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4f348d74c7e4efa94e3052dd84b8c73 2023-02-12 12:03:35,552 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/.tmp/table/5d2d6cea5334455398c19e4cca36e095 2023-02-12 12:03:35,553 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:35,557 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d2d6cea5334455398c19e4cca36e095 2023-02-12 12:03:35,558 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/.tmp/info/890a216a767743aa9239d7df2fa143d0 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/info/890a216a767743aa9239d7df2fa143d0 2023-02-12 12:03:35,561 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 890a216a767743aa9239d7df2fa143d0 2023-02-12 12:03:35,561 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/info/890a216a767743aa9239d7df2fa143d0, entries=30, sequenceid=57, filesize=8.3 K 2023-02-12 12:03:35,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/.tmp/rep_barrier/d4f348d74c7e4efa94e3052dd84b8c73 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/rep_barrier/d4f348d74c7e4efa94e3052dd84b8c73 2023-02-12 12:03:35,566 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4f348d74c7e4efa94e3052dd84b8c73 2023-02-12 12:03:35,566 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/rep_barrier/d4f348d74c7e4efa94e3052dd84b8c73, entries=10, sequenceid=57, filesize=6.1 K 2023-02-12 12:03:35,567 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/.tmp/table/5d2d6cea5334455398c19e4cca36e095 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/table/5d2d6cea5334455398c19e4cca36e095 2023-02-12 12:03:35,569 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:35,571 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d2d6cea5334455398c19e4cca36e095 2023-02-12 12:03:35,571 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/table/5d2d6cea5334455398c19e4cca36e095, entries=13, sequenceid=57, filesize=6.1 K 2023-02-12 12:03:35,572 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=57, compaction requested=false 2023-02-12 12:03:35,575 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 12:03:35,575 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:35,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:35,576 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203415513Running coprocessor pre-close hooks at 1676203415513Disabling compacts and flushes for region at 1676203415513Disabling writes for close at 1676203415516 (+3 ms)Obtaining lock to block concurrent updates at 1676203415516Preparing flush snapshotting stores in 1588230740 at 1676203415516Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676203415517 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676203415517Flushing 1588230740/info: creating writer at 1676203415517Flushing 1588230740/info: appending metadata at 1676203415520 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676203415520Flushing 1588230740/rep_barrier: creating writer at 1676203415533 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676203415535 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676203415535Flushing 1588230740/table: creating writer at 1676203415544 (+9 ms)Flushing 1588230740/table: appending metadata at 1676203415546 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676203415546Flushing 1588230740/info: reopening flushed file at 1676203415558 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676203415563 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676203415567 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 56ms, sequenceid=57, compaction requested=false at 1676203415572 (+5 ms)Writing region close event to WAL at 1676203415573 (+1 ms)Running coprocessor post-close hooks at 1676203415575 (+2 ms)Closed at 1676203415576 (+1 ms) 2023-02-12 12:03:35,577 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:35,713 INFO [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38457,1676203410122; all regions closed. 2023-02-12 12:03:35,716 INFO [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44631,1676203410150; all regions closed. 2023-02-12 12:03:35,720 DEBUG [RS:0;jenkins-hbase4:38457] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/oldWALs 2023-02-12 12:03:35,720 INFO [RS:0;jenkins-hbase4:38457] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38457%2C1676203410122.meta:.meta(num 1676203411123) 2023-02-12 12:03:35,720 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/WALs/jenkins-hbase4.apache.org,44631,1676203410150/jenkins-hbase4.apache.org%2C44631%2C1676203410150.1676203411538 not finished, retry = 0 2023-02-12 12:03:35,724 DEBUG [RS:0;jenkins-hbase4:38457] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/oldWALs 2023-02-12 12:03:35,724 INFO [RS:0;jenkins-hbase4:38457] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38457%2C1676203410122:(num 1676203411838) 2023-02-12 12:03:35,724 DEBUG [RS:0;jenkins-hbase4:38457] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:35,724 INFO [RS:0;jenkins-hbase4:38457] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:35,724 INFO [RS:0;jenkins-hbase4:38457] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:35,724 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:35,725 INFO [RS:0;jenkins-hbase4:38457] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38457 2023-02-12 12:03:35,727 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:35,727 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38457,1676203410122 2023-02-12 12:03:35,727 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:35,727 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:35,728 ERROR [Listener at localhost/37189-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26e8d9e1 rejected from java.util.concurrent.ThreadPoolExecutor@22d759e4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:35,727 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:35,729 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38457,1676203410122] 2023-02-12 12:03:35,729 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38457,1676203410122; numProcessing=1 2023-02-12 12:03:35,730 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38457,1676203410122 already deleted, retry=false 2023-02-12 12:03:35,730 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38457,1676203410122 expired; onlineServers=1 2023-02-12 12:03:35,817 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 12:03:35,817 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 12:03:35,823 DEBUG [RS:1;jenkins-hbase4:44631] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/oldWALs 2023-02-12 12:03:35,823 INFO [RS:1;jenkins-hbase4:44631] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44631%2C1676203410150:(num 1676203411538) 2023-02-12 12:03:35,823 DEBUG [RS:1;jenkins-hbase4:44631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:35,823 INFO [RS:1;jenkins-hbase4:44631] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:35,823 INFO [RS:1;jenkins-hbase4:44631] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:35,823 INFO [RS:1;jenkins-hbase4:44631] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:35,823 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:35,824 INFO [RS:1;jenkins-hbase4:44631] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:35,824 INFO [RS:1;jenkins-hbase4:44631] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:35,824 INFO [RS:1;jenkins-hbase4:44631] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44631 2023-02-12 12:03:35,826 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44631,1676203410150 2023-02-12 12:03:35,826 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:35,826 ERROR [Listener at localhost/37189-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e36c287 rejected from java.util.concurrent.ThreadPoolExecutor@1a095599[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:35,829 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44631,1676203410150] 2023-02-12 12:03:35,829 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44631,1676203410150; numProcessing=2 2023-02-12 12:03:35,830 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44631,1676203410150 already deleted, retry=false 2023-02-12 12:03:35,830 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44631,1676203410150 expired; onlineServers=0 2023-02-12 12:03:35,830 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40569,1676203410076' ***** 2023-02-12 12:03:35,830 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 12:03:35,831 DEBUG [M:0;jenkins-hbase4:40569] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31b839d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:35,831 INFO [M:0;jenkins-hbase4:40569] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40569,1676203410076 2023-02-12 12:03:35,831 INFO [M:0;jenkins-hbase4:40569] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40569,1676203410076; all regions closed. 2023-02-12 12:03:35,831 DEBUG [M:0;jenkins-hbase4:40569] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:35,831 DEBUG [M:0;jenkins-hbase4:40569] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 12:03:35,831 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 12:03:35,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203410724] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203410724,5,FailOnTimeoutGroup] 2023-02-12 12:03:35,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203410723] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203410723,5,FailOnTimeoutGroup] 2023-02-12 12:03:35,831 DEBUG [M:0;jenkins-hbase4:40569] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 12:03:35,832 INFO [M:0;jenkins-hbase4:40569] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 12:03:35,832 INFO [M:0;jenkins-hbase4:40569] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 12:03:35,832 INFO [M:0;jenkins-hbase4:40569] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 12:03:35,832 DEBUG [M:0;jenkins-hbase4:40569] master.HMaster(1502): Stopping service threads 2023-02-12 12:03:35,832 INFO [M:0;jenkins-hbase4:40569] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 12:03:35,833 ERROR [M:0;jenkins-hbase4:40569] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 12:03:35,833 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:35,833 INFO [M:0;jenkins-hbase4:40569] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 12:03:35,833 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:35,833 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 12:03:35,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:35,833 DEBUG [M:0;jenkins-hbase4:40569] zookeeper.ZKUtil(398): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 12:03:35,834 WARN [M:0;jenkins-hbase4:40569] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 12:03:35,834 INFO [M:0;jenkins-hbase4:40569] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 12:03:35,834 INFO [M:0;jenkins-hbase4:40569] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 12:03:35,834 DEBUG [M:0;jenkins-hbase4:40569] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:35,834 INFO [M:0;jenkins-hbase4:40569] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:35,834 DEBUG [M:0;jenkins-hbase4:40569] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:35,834 DEBUG [M:0;jenkins-hbase4:40569] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:35,834 DEBUG [M:0;jenkins-hbase4:40569] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:35,834 INFO [M:0;jenkins-hbase4:40569] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.11 KB heapSize=200.02 KB 2023-02-12 12:03:35,843 INFO [M:0;jenkins-hbase4:40569] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.11 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e4fd09e1d9b64ff3a41c5bc267cbbf95 2023-02-12 12:03:35,846 DEBUG [M:0;jenkins-hbase4:40569] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/e4fd09e1d9b64ff3a41c5bc267cbbf95 as hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e4fd09e1d9b64ff3a41c5bc267cbbf95 2023-02-12 12:03:35,850 INFO [M:0;jenkins-hbase4:40569] regionserver.HStore(1080): Added hdfs://localhost:38993/user/jenkins/test-data/62cd94a1-9ea1-8a98-fda5-0473f8d2b2c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/e4fd09e1d9b64ff3a41c5bc267cbbf95, entries=53, sequenceid=357, filesize=10.7 K 2023-02-12 12:03:35,850 INFO [M:0;jenkins-hbase4:40569] regionserver.HRegion(2947): Finished flush of dataSize ~167.11 KB/171122, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-12 12:03:35,851 INFO [M:0;jenkins-hbase4:40569] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:35,851 DEBUG [M:0;jenkins-hbase4:40569] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203415834Disabling compacts and flushes for region at 1676203415834Disabling writes for close at 1676203415834Obtaining lock to block concurrent updates at 1676203415834Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676203415834Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171122, getHeapSize=204800, getOffHeapSize=0, getCellsCount=442 at 1676203415835 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676203415835Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676203415836 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676203415838 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676203415838Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676203415847 (+9 ms)Finished flush of dataSize ~167.11 KB/171122, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false at 1676203415850 (+3 ms)Writing region close event to WAL at 1676203415851 (+1 ms)Closed at 1676203415851 2023-02-12 12:03:35,853 INFO [M:0;jenkins-hbase4:40569] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 12:03:35,853 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:35,854 INFO [M:0;jenkins-hbase4:40569] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40569 2023-02-12 12:03:35,856 DEBUG [M:0;jenkins-hbase4:40569] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40569,1676203410076 already deleted, retry=false 2023-02-12 12:03:36,009 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:36,009 INFO [M:0;jenkins-hbase4:40569] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40569,1676203410076; zookeeper connection closed. 2023-02-12 12:03:36,009 ERROR [Listener at localhost/37189-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5fc8aa93 rejected from java.util.concurrent.ThreadPoolExecutor@5bf735b2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:36,010 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): master:40569-0x100486a2c4d0000, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:36,010 ERROR [Listener at localhost/37189-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@352704fa rejected from java.util.concurrent.ThreadPoolExecutor@5bf735b2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:36,109 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:36,109 INFO [RS:1;jenkins-hbase4:44631] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44631,1676203410150; zookeeper connection closed. 2023-02-12 12:03:36,109 ERROR [Listener at localhost/37189-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4694a3c2 rejected from java.util.concurrent.ThreadPoolExecutor@1a095599[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:36,109 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@76624585] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@76624585 2023-02-12 12:03:36,109 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x100486a2c4d0002, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:36,109 ERROR [Listener at localhost/37189-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3eeb46ba rejected from java.util.concurrent.ThreadPoolExecutor@1a095599[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:36,209 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:36,209 INFO [RS:0;jenkins-hbase4:38457] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38457,1676203410122; zookeeper connection closed. 2023-02-12 12:03:36,209 ERROR [Listener at localhost/37189-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36bff626 rejected from java.util.concurrent.ThreadPoolExecutor@22d759e4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:36,210 DEBUG [Listener at localhost/37189-EventThread] zookeeper.ZKWatcher(600): regionserver:38457-0x100486a2c4d0001, quorum=127.0.0.1:62383, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:36,210 ERROR [Listener at localhost/37189-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e786d83 rejected from java.util.concurrent.ThreadPoolExecutor@22d759e4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:36,211 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6cc856e0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6cc856e0 2023-02-12 12:03:36,211 INFO [Listener at localhost/37189] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 12:03:36,211 WARN [Listener at localhost/37189] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:36,214 INFO [Listener at localhost/37189] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:36,320 WARN [BP-1782023798-172.31.14.131-1676203409398 heartbeating to localhost/127.0.0.1:38993] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:36,321 WARN [BP-1782023798-172.31.14.131-1676203409398 heartbeating to localhost/127.0.0.1:38993] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1782023798-172.31.14.131-1676203409398 (Datanode Uuid 3acec884-f981-4a01-86ad-98c945e6ace9) service to localhost/127.0.0.1:38993 2023-02-12 12:03:36,322 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/cluster_651cb6e7-e9aa-d523-2acc-c778996bc62e/dfs/data/data3/current/BP-1782023798-172.31.14.131-1676203409398] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:36,322 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/cluster_651cb6e7-e9aa-d523-2acc-c778996bc62e/dfs/data/data4/current/BP-1782023798-172.31.14.131-1676203409398] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:36,323 WARN [Listener at localhost/37189] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:36,326 INFO [Listener at localhost/37189] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:36,430 WARN [BP-1782023798-172.31.14.131-1676203409398 heartbeating to localhost/127.0.0.1:38993] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:36,431 WARN [BP-1782023798-172.31.14.131-1676203409398 heartbeating to localhost/127.0.0.1:38993] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1782023798-172.31.14.131-1676203409398 (Datanode Uuid 52c039fb-6cf6-4ce5-aec9-68ee6407a20a) service to localhost/127.0.0.1:38993 2023-02-12 12:03:36,436 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/cluster_651cb6e7-e9aa-d523-2acc-c778996bc62e/dfs/data/data1/current/BP-1782023798-172.31.14.131-1676203409398] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:36,436 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/cluster_651cb6e7-e9aa-d523-2acc-c778996bc62e/dfs/data/data2/current/BP-1782023798-172.31.14.131-1676203409398] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:36,445 INFO [Listener at localhost/37189] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:36,564 INFO [Listener at localhost/37189] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 12:03:36,599 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 12:03:36,614 INFO [Listener at localhost/37189] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=229 (was 179) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:38993 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37189 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:38993 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:38993 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,40569,1676203410076)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:38993 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38993 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:38993 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37189.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:38993 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=634 (was 570) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=313 (was 332), ProcessCount=166 (was 166), AvailableMemoryMB=3990 (was 4118) 2023-02-12 12:03:36,624 INFO [Listener at localhost/37189] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=229, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=166, AvailableMemoryMB=3990 2023-02-12 12:03:36,634 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/hadoop.log.dir so I do NOT create it in target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e 2023-02-12 12:03:36,634 WARN [Listener at localhost/37189] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 12:03:36,634 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/hadoop.tmp.dir so I do NOT create it in target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e 2023-02-12 12:03:36,634 WARN [Listener at localhost/37189] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/52c48662-ce26-95f5-5d9f-4b6dba11220a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 12:03:36,634 DEBUG [Listener at localhost/37189] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e 2023-02-12 12:03:36,634 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 12:03:36,634 INFO [Listener at localhost/37189] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/cluster_aa5ee910-e16a-cf94-3562-33f4840f97f4, deleteOnExit=true 2023-02-12 12:03:36,634 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 12:03:36,634 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/test.cache.data in system properties and HBase conf 2023-02-12 12:03:36,635 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 12:03:36,635 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/hadoop.log.dir in system properties and HBase conf 2023-02-12 12:03:36,635 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 12:03:36,635 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 12:03:36,635 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 12:03:36,635 DEBUG [Listener at localhost/37189] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 12:03:36,635 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:36,635 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:36,635 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 12:03:36,635 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/nfs.dump.dir in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/java.io.tmpdir in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 12:03:36,636 INFO [Listener at localhost/37189] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 12:03:36,640 WARN [Listener at localhost/37189] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:36,640 WARN [Listener at localhost/37189] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:36,642 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 12:03:36,728 WARN [Listener at localhost/37189] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:36,730 INFO [Listener at localhost/37189] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:36,734 INFO [Listener at localhost/37189] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/java.io.tmpdir/Jetty_localhost_43037_hdfs____.pz1fhd/webapp 2023-02-12 12:03:36,825 INFO [Listener at localhost/37189] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43037 2023-02-12 12:03:36,868 WARN [Listener at localhost/37189] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:36,868 WARN [Listener at localhost/37189] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:36,919 WARN [Listener at localhost/40673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:36,943 WARN [Listener at localhost/40673] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:36,945 WARN [Listener at localhost/40673] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:36,946 INFO [Listener at localhost/40673] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:36,951 INFO [Listener at localhost/40673] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/java.io.tmpdir/Jetty_localhost_46183_datanode____.n02z8v/webapp 2023-02-12 12:03:37,041 INFO [Listener at localhost/40673] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46183 2023-02-12 12:03:37,049 WARN [Listener at localhost/42195] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:37,069 WARN [Listener at localhost/42195] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:37,072 WARN [Listener at localhost/42195] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:37,073 INFO [Listener at localhost/42195] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:37,078 INFO [Listener at localhost/42195] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/java.io.tmpdir/Jetty_localhost_41841_datanode____nsmprz/webapp 2023-02-12 12:03:37,162 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2f6cb59b8ccdff20: Processing first storage report for DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2 from datanode b8bd1c86-ea49-4610-a262-311ece067b2f 2023-02-12 12:03:37,162 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2f6cb59b8ccdff20: from storage DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2 node DatanodeRegistration(127.0.0.1:38407, datanodeUuid=b8bd1c86-ea49-4610-a262-311ece067b2f, infoPort=45821, infoSecurePort=0, ipcPort=42195, storageInfo=lv=-57;cid=testClusterID;nsid=783411847;c=1676203416685), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:37,163 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2f6cb59b8ccdff20: Processing first storage report for DS-c43eed7b-40bc-401a-b892-2a0783081f4c from datanode b8bd1c86-ea49-4610-a262-311ece067b2f 2023-02-12 12:03:37,163 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2f6cb59b8ccdff20: from storage DS-c43eed7b-40bc-401a-b892-2a0783081f4c node DatanodeRegistration(127.0.0.1:38407, datanodeUuid=b8bd1c86-ea49-4610-a262-311ece067b2f, infoPort=45821, infoSecurePort=0, ipcPort=42195, storageInfo=lv=-57;cid=testClusterID;nsid=783411847;c=1676203416685), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 12:03:37,187 INFO [Listener at localhost/42195] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41841 2023-02-12 12:03:37,196 WARN [Listener at localhost/35833] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:37,290 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28254d090ca13d5f: Processing first storage report for DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd from datanode dfe769f0-fff9-40fa-a373-1ae5964d9bc7 2023-02-12 12:03:37,290 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28254d090ca13d5f: from storage DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd node DatanodeRegistration(127.0.0.1:43309, datanodeUuid=dfe769f0-fff9-40fa-a373-1ae5964d9bc7, infoPort=41199, infoSecurePort=0, ipcPort=35833, storageInfo=lv=-57;cid=testClusterID;nsid=783411847;c=1676203416685), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:37,290 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28254d090ca13d5f: Processing first storage report for DS-4959f9dd-a3c0-4cfb-9b34-3d6096050e20 from datanode dfe769f0-fff9-40fa-a373-1ae5964d9bc7 2023-02-12 12:03:37,290 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28254d090ca13d5f: from storage DS-4959f9dd-a3c0-4cfb-9b34-3d6096050e20 node DatanodeRegistration(127.0.0.1:43309, datanodeUuid=dfe769f0-fff9-40fa-a373-1ae5964d9bc7, infoPort=41199, infoSecurePort=0, ipcPort=35833, storageInfo=lv=-57;cid=testClusterID;nsid=783411847;c=1676203416685), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:37,303 DEBUG [Listener at localhost/35833] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e 2023-02-12 12:03:37,305 INFO [Listener at localhost/35833] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/cluster_aa5ee910-e16a-cf94-3562-33f4840f97f4/zookeeper_0, clientPort=63498, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/cluster_aa5ee910-e16a-cf94-3562-33f4840f97f4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/cluster_aa5ee910-e16a-cf94-3562-33f4840f97f4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 12:03:37,306 INFO [Listener at localhost/35833] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63498 2023-02-12 12:03:37,306 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,307 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,319 INFO [Listener at localhost/35833] util.FSUtils(479): Created version file at hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666 with version=8 2023-02-12 12:03:37,319 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,320 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,321 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40673/user/jenkins/test-data/666d3832-c274-6952-5c8b-42c837cc05d8/hbase-staging 2023-02-12 12:03:37,323 INFO [Listener at localhost/35833] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:37,323 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:37,323 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:37,323 INFO [Listener at localhost/35833] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:37,323 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:37,323 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:37,323 INFO [Listener at localhost/35833] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:37,324 INFO [Listener at localhost/35833] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42059 2023-02-12 12:03:37,324 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,325 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,326 INFO [Listener at localhost/35833] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42059 connecting to ZooKeeper ensemble=127.0.0.1:63498 2023-02-12 12:03:37,333 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:420590x0, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:37,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42059-0x100486a489d0000 connected 2023-02-12 12:03:37,348 DEBUG [Listener at localhost/35833] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:37,348 DEBUG [Listener at localhost/35833] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:37,348 DEBUG [Listener at localhost/35833] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:37,349 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42059 2023-02-12 12:03:37,349 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42059 2023-02-12 12:03:37,352 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42059 2023-02-12 12:03:37,352 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42059 2023-02-12 12:03:37,352 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42059 2023-02-12 12:03:37,352 INFO [Listener at localhost/35833] master.HMaster(439): hbase.rootdir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666, hbase.cluster.distributed=false 2023-02-12 12:03:37,365 INFO [Listener at localhost/35833] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:37,365 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:37,365 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:37,365 INFO [Listener at localhost/35833] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:37,365 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:37,365 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:37,365 INFO [Listener at localhost/35833] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:37,366 INFO [Listener at localhost/35833] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34761 2023-02-12 12:03:37,366 INFO [Listener at localhost/35833] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:37,368 DEBUG [Listener at localhost/35833] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:37,369 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,369 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,370 INFO [Listener at localhost/35833] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34761 connecting to ZooKeeper ensemble=127.0.0.1:63498 2023-02-12 12:03:37,373 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:347610x0, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:37,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34761-0x100486a489d0001 connected 2023-02-12 12:03:37,376 DEBUG [Listener at localhost/35833] zookeeper.ZKUtil(164): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:37,377 DEBUG [Listener at localhost/35833] zookeeper.ZKUtil(164): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:37,377 DEBUG [Listener at localhost/35833] zookeeper.ZKUtil(164): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:37,378 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34761 2023-02-12 12:03:37,379 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34761 2023-02-12 12:03:37,380 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34761 2023-02-12 12:03:37,380 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34761 2023-02-12 12:03:37,380 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34761 2023-02-12 12:03:37,391 INFO [Listener at localhost/35833] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:37,391 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:37,391 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:37,391 INFO [Listener at localhost/35833] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:37,391 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:37,391 INFO [Listener at localhost/35833] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:37,391 INFO [Listener at localhost/35833] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:37,393 INFO [Listener at localhost/35833] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37027 2023-02-12 12:03:37,393 INFO [Listener at localhost/35833] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:37,394 DEBUG [Listener at localhost/35833] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:37,394 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,395 INFO [Listener at localhost/35833] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,396 INFO [Listener at localhost/35833] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37027 connecting to ZooKeeper ensemble=127.0.0.1:63498 2023-02-12 12:03:37,403 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:370270x0, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:37,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37027-0x100486a489d0002 connected 2023-02-12 12:03:37,405 DEBUG [Listener at localhost/35833] zookeeper.ZKUtil(164): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:37,405 DEBUG [Listener at localhost/35833] zookeeper.ZKUtil(164): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:37,405 DEBUG [Listener at localhost/35833] zookeeper.ZKUtil(164): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:37,407 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37027 2023-02-12 12:03:37,408 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37027 2023-02-12 12:03:37,410 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37027 2023-02-12 12:03:37,410 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37027 2023-02-12 12:03:37,412 DEBUG [Listener at localhost/35833] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37027 2023-02-12 12:03:37,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:37,417 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:37,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:37,418 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:37,418 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:37,418 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:37,419 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:37,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:37,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42059,1676203417322 from backup master directory 2023-02-12 12:03:37,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:37,423 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:37,423 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:37,423 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:37,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:37,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/hbase.id with ID: 97ec7be0-b938-4378-a4f4-d237b26e4d9e 2023-02-12 12:03:37,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:37,449 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:37,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x643557ac to 127.0.0.1:63498 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:37,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a98d68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:37,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:37,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 12:03:37,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:37,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/data/master/store-tmp 2023-02-12 12:03:37,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:37,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:37,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:37,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:37,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:37,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:37,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:37,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203417468Disabling compacts and flushes for region at 1676203417468Disabling writes for close at 1676203417468Writing region close event to WAL at 1676203417468Closed at 1676203417468 2023-02-12 12:03:37,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/WALs/jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:37,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42059%2C1676203417322, suffix=, logDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/WALs/jenkins-hbase4.apache.org,42059,1676203417322, archiveDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/oldWALs, maxLogs=10 2023-02-12 12:03:37,486 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38407,DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2,DISK] 2023-02-12 12:03:37,486 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43309,DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd,DISK] 2023-02-12 12:03:37,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/WALs/jenkins-hbase4.apache.org,42059,1676203417322/jenkins-hbase4.apache.org%2C42059%2C1676203417322.1676203417471 2023-02-12 12:03:37,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38407,DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2,DISK], DatanodeInfoWithStorage[127.0.0.1:43309,DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd,DISK]] 2023-02-12 12:03:37,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:37,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:37,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:37,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:37,490 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:37,491 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 12:03:37,492 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 12:03:37,492 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:37,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:37,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:37,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:37,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:37,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62704810, jitterRate=-0.06562551856040955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:37,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676203417488Initializing all the Stores at 1676203417489 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203417489Cleaning up temporary data from old regions at 1676203417494 (+5 ms)Cleaning up detritus from prior splits at 1676203417494Region opened successfully at 1676203417501 (+7 ms) 2023-02-12 12:03:37,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 12:03:37,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 12:03:37,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 12:03:37,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 12:03:37,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 12:03:37,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 12:03:37,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 12:03:37,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 12:03:37,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 12:03:37,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 12:03:37,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 12:03:37,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 12:03:37,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 12:03:37,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 12:03:37,516 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:37,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 12:03:37,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 12:03:37,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 12:03:37,519 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:37,519 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:37,519 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:37,519 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:37,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42059,1676203417322, sessionid=0x100486a489d0000, setting cluster-up flag (Was=false) 2023-02-12 12:03:37,525 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:37,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 12:03:37,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:37,533 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:37,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 12:03:37,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:37,538 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.hbase-snapshot/.tmp 2023-02-12 12:03:37,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:37,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:37,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:37,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:37,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:37,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 12:03:37,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:37,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676203447541 2023-02-12 12:03:37,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 12:03:37,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 12:03:37,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 12:03:37,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 12:03:37,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 12:03:37,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 12:03:37,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,543 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:37,543 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 12:03:37,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 12:03:37,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 12:03:37,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 12:03:37,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 12:03:37,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 12:03:37,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203417544,5,FailOnTimeoutGroup] 2023-02-12 12:03:37,544 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:37,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203417544,5,FailOnTimeoutGroup] 2023-02-12 12:03:37,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 12:03:37,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,554 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:37,554 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:37,554 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666 2023-02-12 12:03:37,563 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:37,564 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:37,565 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/info 2023-02-12 12:03:37,565 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:37,565 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:37,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:37,566 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:37,567 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:37,567 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:37,567 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:37,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/table 2023-02-12 12:03:37,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:37,568 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:37,569 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740 2023-02-12 12:03:37,569 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740 2023-02-12 12:03:37,570 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:37,571 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:37,572 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:37,573 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61333024, jitterRate=-0.08606672286987305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:37,573 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676203417563Initializing all the Stores at 1676203417563Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203417564 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203417564Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203417564Cleaning up temporary data from old regions at 1676203417570 (+6 ms)Cleaning up detritus from prior splits at 1676203417570Region opened successfully at 1676203417573 (+3 ms) 2023-02-12 12:03:37,573 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:37,573 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:37,573 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:37,573 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:37,573 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:37,573 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:37,573 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203417573Disabling compacts and flushes for region at 1676203417573Disabling writes for close at 1676203417573Writing region close event to WAL at 1676203417573Closed at 1676203417573 2023-02-12 12:03:37,574 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:37,574 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 12:03:37,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 12:03:37,575 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 12:03:37,576 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 12:03:37,616 INFO [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(952): ClusterId : 97ec7be0-b938-4378-a4f4-d237b26e4d9e 2023-02-12 12:03:37,616 INFO [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(952): ClusterId : 97ec7be0-b938-4378-a4f4-d237b26e4d9e 2023-02-12 12:03:37,616 DEBUG [RS:0;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:37,616 DEBUG [RS:1;jenkins-hbase4:37027] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:37,618 DEBUG [RS:0;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:37,618 DEBUG [RS:1;jenkins-hbase4:37027] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:37,618 DEBUG [RS:0;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:37,618 DEBUG [RS:1;jenkins-hbase4:37027] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:37,620 DEBUG [RS:0;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:37,620 DEBUG [RS:1;jenkins-hbase4:37027] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:37,622 DEBUG [RS:0;jenkins-hbase4:34761] zookeeper.ReadOnlyZKClient(139): Connect 0x7e78f5b4 to 127.0.0.1:63498 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:37,622 DEBUG [RS:1;jenkins-hbase4:37027] zookeeper.ReadOnlyZKClient(139): Connect 0x5062eed9 to 127.0.0.1:63498 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:37,630 DEBUG [RS:0;jenkins-hbase4:34761] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70bf040b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:37,630 DEBUG [RS:1;jenkins-hbase4:37027] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ea51aa5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:37,630 DEBUG [RS:0;jenkins-hbase4:34761] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74809ec4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:37,630 DEBUG [RS:1;jenkins-hbase4:37027] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a9a85a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:37,639 DEBUG [RS:0;jenkins-hbase4:34761] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34761 2023-02-12 12:03:37,639 INFO [RS:0;jenkins-hbase4:34761] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:37,639 INFO [RS:0;jenkins-hbase4:34761] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:37,639 DEBUG [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:37,639 INFO [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42059,1676203417322 with isa=jenkins-hbase4.apache.org/172.31.14.131:34761, startcode=1676203417364 2023-02-12 12:03:37,639 DEBUG [RS:0;jenkins-hbase4:34761] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:37,641 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48687, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:37,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:37,643 DEBUG [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666 2023-02-12 12:03:37,643 DEBUG [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40673 2023-02-12 12:03:37,643 DEBUG [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:37,643 DEBUG [RS:1;jenkins-hbase4:37027] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37027 2023-02-12 12:03:37,643 INFO [RS:1;jenkins-hbase4:37027] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:37,643 INFO [RS:1;jenkins-hbase4:37027] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:37,643 DEBUG [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:37,644 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:37,644 INFO [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42059,1676203417322 with isa=jenkins-hbase4.apache.org/172.31.14.131:37027, startcode=1676203417391 2023-02-12 12:03:37,644 DEBUG [RS:1;jenkins-hbase4:37027] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:37,645 DEBUG [RS:0;jenkins-hbase4:34761] zookeeper.ZKUtil(162): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:37,645 WARN [RS:0;jenkins-hbase4:34761] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:37,645 INFO [RS:0;jenkins-hbase4:34761] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:37,645 DEBUG [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/WALs/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:37,645 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34761,1676203417364] 2023-02-12 12:03:37,648 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37053, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:37,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:37,649 DEBUG [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666 2023-02-12 12:03:37,649 DEBUG [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40673 2023-02-12 12:03:37,649 DEBUG [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:37,649 DEBUG [RS:0;jenkins-hbase4:34761] zookeeper.ZKUtil(162): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:37,655 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:37,655 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:37,655 DEBUG [RS:1;jenkins-hbase4:37027] zookeeper.ZKUtil(162): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:37,655 WARN [RS:1;jenkins-hbase4:37027] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:37,655 INFO [RS:1;jenkins-hbase4:37027] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:37,655 DEBUG [RS:0;jenkins-hbase4:34761] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:37,655 DEBUG [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/WALs/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:37,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:37,656 INFO [RS:0;jenkins-hbase4:34761] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:37,655 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37027,1676203417391] 2023-02-12 12:03:37,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:37,658 INFO [RS:0;jenkins-hbase4:34761] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:37,658 INFO [RS:0;jenkins-hbase4:34761] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:37,658 INFO [RS:0;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,658 INFO [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:37,659 DEBUG [RS:1;jenkins-hbase4:37027] zookeeper.ZKUtil(162): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:37,659 DEBUG [RS:1;jenkins-hbase4:37027] zookeeper.ZKUtil(162): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:37,659 INFO [RS:0;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,660 DEBUG [RS:1;jenkins-hbase4:37027] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,660 INFO [RS:1;jenkins-hbase4:37027] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,660 DEBUG [RS:0;jenkins-hbase4:34761] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,663 INFO [RS:1;jenkins-hbase4:37027] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:37,664 INFO [RS:0;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,665 INFO [RS:0;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,665 INFO [RS:0;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,665 INFO [RS:1;jenkins-hbase4:37027] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:37,665 INFO [RS:1;jenkins-hbase4:37027] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,665 INFO [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:37,666 INFO [RS:1;jenkins-hbase4:37027] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,667 DEBUG [RS:1;jenkins-hbase4:37027] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:37,672 INFO [RS:1;jenkins-hbase4:37027] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,672 INFO [RS:1;jenkins-hbase4:37027] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,672 INFO [RS:1;jenkins-hbase4:37027] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,677 INFO [RS:0;jenkins-hbase4:34761] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:37,677 INFO [RS:0;jenkins-hbase4:34761] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34761,1676203417364-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,682 INFO [RS:1;jenkins-hbase4:37027] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:37,682 INFO [RS:1;jenkins-hbase4:37027] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37027,1676203417391-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,687 INFO [RS:0;jenkins-hbase4:34761] regionserver.Replication(203): jenkins-hbase4.apache.org,34761,1676203417364 started 2023-02-12 12:03:37,687 INFO [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34761,1676203417364, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34761, sessionid=0x100486a489d0001 2023-02-12 12:03:37,687 DEBUG [RS:0;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:37,687 DEBUG [RS:0;jenkins-hbase4:34761] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:37,687 DEBUG [RS:0;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34761,1676203417364' 2023-02-12 12:03:37,687 DEBUG [RS:0;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:37,688 DEBUG [RS:0;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:37,688 DEBUG [RS:0;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:37,688 DEBUG [RS:0;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:37,688 DEBUG [RS:0;jenkins-hbase4:34761] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:37,688 DEBUG [RS:0;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34761,1676203417364' 2023-02-12 12:03:37,688 DEBUG [RS:0;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:37,688 DEBUG [RS:0;jenkins-hbase4:34761] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:37,689 DEBUG [RS:0;jenkins-hbase4:34761] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:37,689 INFO [RS:0;jenkins-hbase4:34761] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:37,689 INFO [RS:0;jenkins-hbase4:34761] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:37,693 INFO [RS:1;jenkins-hbase4:37027] regionserver.Replication(203): jenkins-hbase4.apache.org,37027,1676203417391 started 2023-02-12 12:03:37,693 INFO [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37027,1676203417391, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37027, sessionid=0x100486a489d0002 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37027,1676203417391' 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37027,1676203417391' 2023-02-12 12:03:37,693 DEBUG [RS:1;jenkins-hbase4:37027] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:37,694 DEBUG [RS:1;jenkins-hbase4:37027] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:37,694 DEBUG [RS:1;jenkins-hbase4:37027] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:37,694 INFO [RS:1;jenkins-hbase4:37027] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:37,694 INFO [RS:1;jenkins-hbase4:37027] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:37,726 DEBUG [jenkins-hbase4:42059] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 12:03:37,727 DEBUG [jenkins-hbase4:42059] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:37,728 DEBUG [jenkins-hbase4:42059] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:37,728 DEBUG [jenkins-hbase4:42059] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:37,728 DEBUG [jenkins-hbase4:42059] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:37,728 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34761,1676203417364, state=OPENING 2023-02-12 12:03:37,729 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 12:03:37,731 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:37,731 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:37,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34761,1676203417364}] 2023-02-12 12:03:37,887 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:37,887 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:37,889 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:37,893 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 12:03:37,893 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:37,894 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34761%2C1676203417364.meta, suffix=.meta, logDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/WALs/jenkins-hbase4.apache.org,34761,1676203417364, archiveDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/oldWALs, maxLogs=32 2023-02-12 12:03:37,907 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43309,DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd,DISK] 2023-02-12 12:03:37,907 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38407,DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2,DISK] 2023-02-12 12:03:37,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/WALs/jenkins-hbase4.apache.org,34761,1676203417364/jenkins-hbase4.apache.org%2C34761%2C1676203417364.meta.1676203417894.meta 2023-02-12 12:03:37,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43309,DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd,DISK], DatanodeInfoWithStorage[127.0.0.1:38407,DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2,DISK]] 2023-02-12 12:03:37,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:37,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 12:03:37,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 12:03:37,909 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 12:03:37,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 12:03:37,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:37,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 12:03:37,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 12:03:37,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:37,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/info 2023-02-12 12:03:37,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/info 2023-02-12 12:03:37,911 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:37,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:37,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:37,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:37,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:37,913 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:37,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:37,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:37,914 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/table 2023-02-12 12:03:37,914 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/table 2023-02-12 12:03:37,914 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:37,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:37,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740 2023-02-12 12:03:37,916 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740 2023-02-12 12:03:37,918 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:37,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:37,919 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67093401, jitterRate=-2.304166555404663E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:37,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676203417909Writing region info on filesystem at 1676203417909Initializing all the Stores at 1676203417910 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203417910Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203417910Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203417910Cleaning up temporary data from old regions at 1676203417917 (+7 ms)Cleaning up detritus from prior splits at 1676203417917Running coprocessor post-open hooks at 1676203417919 (+2 ms)Region opened successfully at 1676203417919 2023-02-12 12:03:37,920 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676203417887 2023-02-12 12:03:37,923 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 12:03:37,924 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 12:03:37,924 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34761,1676203417364, state=OPEN 2023-02-12 12:03:37,925 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 12:03:37,925 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:37,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 12:03:37,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34761,1676203417364 in 194 msec 2023-02-12 12:03:37,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 12:03:37,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-12 12:03:37,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 389 msec 2023-02-12 12:03:37,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676203417417, completionTime=-1 2023-02-12 12:03:37,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 12:03:37,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 12:03:37,932 DEBUG [hconnection-0x5bfe275e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:37,934 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53024, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:37,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 12:03:37,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676203477935 2023-02-12 12:03:37,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676203537935 2023-02-12 12:03:37,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-12 12:03:37,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42059,1676203417322-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42059,1676203417322-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42059,1676203417322-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42059, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:37,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 12:03:37,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:37,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 12:03:37,945 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 12:03:37,945 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:37,945 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:37,947 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:37,947 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667 empty. 2023-02-12 12:03:37,947 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:37,948 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 12:03:37,957 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:37,958 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6ae9adf3e18b7013251506ca6d68f667, NAME => 'hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp 2023-02-12 12:03:37,963 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:37,963 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 6ae9adf3e18b7013251506ca6d68f667, disabling compactions & flushes 2023-02-12 12:03:37,963 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:37,963 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:37,963 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. after waiting 0 ms 2023-02-12 12:03:37,963 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:37,963 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:37,963 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 6ae9adf3e18b7013251506ca6d68f667: Waiting for close lock at 1676203417963Disabling compacts and flushes for region at 1676203417963Disabling writes for close at 1676203417963Writing region close event to WAL at 1676203417963Closed at 1676203417963 2023-02-12 12:03:37,965 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:37,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203417966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203417966"}]},"ts":"1676203417966"} 2023-02-12 12:03:37,968 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:37,968 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:37,969 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203417968"}]},"ts":"1676203417968"} 2023-02-12 12:03:37,969 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 12:03:37,972 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:37,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:37,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:37,973 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:37,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6ae9adf3e18b7013251506ca6d68f667, ASSIGN}] 2023-02-12 12:03:37,975 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6ae9adf3e18b7013251506ca6d68f667, ASSIGN 2023-02-12 12:03:37,976 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6ae9adf3e18b7013251506ca6d68f667, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37027,1676203417391; forceNewPlan=false, retain=false 2023-02-12 12:03:38,126 INFO [jenkins-hbase4:42059] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:38,126 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6ae9adf3e18b7013251506ca6d68f667, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:38,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203418126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203418126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203418126"}]},"ts":"1676203418126"} 2023-02-12 12:03:38,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6ae9adf3e18b7013251506ca6d68f667, server=jenkins-hbase4.apache.org,37027,1676203417391}] 2023-02-12 12:03:38,280 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:38,281 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:38,282 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36684, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:38,285 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:38,286 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37027%2C1676203417391, suffix=, logDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/WALs/jenkins-hbase4.apache.org,37027,1676203417391, archiveDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/oldWALs, maxLogs=32 2023-02-12 12:03:38,299 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38407,DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2,DISK] 2023-02-12 12:03:38,299 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43309,DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd,DISK] 2023-02-12 12:03:38,301 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/WALs/jenkins-hbase4.apache.org,37027,1676203417391/jenkins-hbase4.apache.org%2C37027%2C1676203417391.1676203418286 2023-02-12 12:03:38,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38407,DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2,DISK], DatanodeInfoWithStorage[127.0.0.1:43309,DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd,DISK]] 2023-02-12 12:03:38,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6ae9adf3e18b7013251506ca6d68f667, NAME => 'hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:38,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:38,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:38,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:38,301 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:38,302 INFO [StoreOpener-6ae9adf3e18b7013251506ca6d68f667-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:38,303 DEBUG [StoreOpener-6ae9adf3e18b7013251506ca6d68f667-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667/info 2023-02-12 12:03:38,303 DEBUG [StoreOpener-6ae9adf3e18b7013251506ca6d68f667-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667/info 2023-02-12 12:03:38,304 INFO [StoreOpener-6ae9adf3e18b7013251506ca6d68f667-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ae9adf3e18b7013251506ca6d68f667 columnFamilyName info 2023-02-12 12:03:38,304 INFO [StoreOpener-6ae9adf3e18b7013251506ca6d68f667-1] regionserver.HStore(310): Store=6ae9adf3e18b7013251506ca6d68f667/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:38,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:38,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:38,307 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:38,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:38,308 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6ae9adf3e18b7013251506ca6d68f667; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72160788, jitterRate=0.07527953386306763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:38,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6ae9adf3e18b7013251506ca6d68f667: Running coprocessor pre-open hook at 1676203418301Writing region info on filesystem at 1676203418301Initializing all the Stores at 1676203418302 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203418302Cleaning up temporary data from old regions at 1676203418305 (+3 ms)Cleaning up detritus from prior splits at 1676203418305Running coprocessor post-open hooks at 1676203418308 (+3 ms)Region opened successfully at 1676203418308 2023-02-12 12:03:38,309 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667., pid=6, masterSystemTime=1676203418280 2023-02-12 12:03:38,312 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:38,313 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:38,313 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6ae9adf3e18b7013251506ca6d68f667, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:38,313 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203418313"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203418313"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203418313"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203418313"}]},"ts":"1676203418313"} 2023-02-12 12:03:38,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 12:03:38,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6ae9adf3e18b7013251506ca6d68f667, server=jenkins-hbase4.apache.org,37027,1676203417391 in 186 msec 2023-02-12 12:03:38,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 12:03:38,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6ae9adf3e18b7013251506ca6d68f667, ASSIGN in 343 msec 2023-02-12 12:03:38,318 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:38,318 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203418318"}]},"ts":"1676203418318"} 2023-02-12 12:03:38,319 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 12:03:38,322 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:38,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 379 msec 2023-02-12 12:03:38,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 12:03:38,345 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:38,346 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:38,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:38,349 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36686, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:38,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 12:03:38,358 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:38,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 12:03:38,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 12:03:38,368 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:38,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 12:03:38,375 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 12:03:38,378 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 12:03:38,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.955sec 2023-02-12 12:03:38,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 12:03:38,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 12:03:38,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 12:03:38,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42059,1676203417322-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 12:03:38,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42059,1676203417322-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 12:03:38,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 12:03:38,416 DEBUG [Listener at localhost/35833] zookeeper.ReadOnlyZKClient(139): Connect 0x7623abee to 127.0.0.1:63498 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:38,427 DEBUG [Listener at localhost/35833] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48670a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:38,428 DEBUG [hconnection-0xc489a8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:38,430 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53034, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:38,431 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:38,431 DEBUG [Listener at localhost/35833] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 12:03:38,436 DEBUG [Listener at localhost/35833] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 12:03:38,438 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56840, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 12:03:38,438 INFO [Listener at localhost/35833] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 12:03:38,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-12 12:03:38,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 12:03:38,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:56840 deadline: 1676203478439, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-12 12:03:38,439 INFO [Listener at localhost/35833] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-12 12:03:38,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:38,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:38,443 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:38,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-12 12:03:38,444 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:38,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:38,445 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,446 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7 empty. 2023-02-12 12:03:38,446 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,446 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 12:03:38,453 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:38,454 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => d5f7a8d106f32465f7904c7e950236e7, NAME => 'testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp 2023-02-12 12:03:38,460 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:38,460 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing d5f7a8d106f32465f7904c7e950236e7, disabling compactions & flushes 2023-02-12 12:03:38,460 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:38,460 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:38,460 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. after waiting 0 ms 2023-02-12 12:03:38,460 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:38,460 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:38,460 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for d5f7a8d106f32465f7904c7e950236e7: Waiting for close lock at 1676203418460Disabling compacts and flushes for region at 1676203418460Disabling writes for close at 1676203418460Writing region close event to WAL at 1676203418460Closed at 1676203418460 2023-02-12 12:03:38,462 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:38,463 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676203418462"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203418462"}]},"ts":"1676203418462"} 2023-02-12 12:03:38,464 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:38,464 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:38,464 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203418464"}]},"ts":"1676203418464"} 2023-02-12 12:03:38,465 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-12 12:03:38,473 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:38,474 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:38,474 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:38,474 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:38,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d5f7a8d106f32465f7904c7e950236e7, ASSIGN}] 2023-02-12 12:03:38,476 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d5f7a8d106f32465f7904c7e950236e7, ASSIGN 2023-02-12 12:03:38,476 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d5f7a8d106f32465f7904c7e950236e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37027,1676203417391; forceNewPlan=false, retain=false 2023-02-12 12:03:38,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:38,627 INFO [jenkins-hbase4:42059] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:38,627 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d5f7a8d106f32465f7904c7e950236e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:38,627 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676203418627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203418627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203418627"}]},"ts":"1676203418627"} 2023-02-12 12:03:38,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure d5f7a8d106f32465f7904c7e950236e7, server=jenkins-hbase4.apache.org,37027,1676203417391}] 2023-02-12 12:03:38,690 INFO [RS:0;jenkins-hbase4:34761] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34761%2C1676203417364, suffix=, logDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/WALs/jenkins-hbase4.apache.org,34761,1676203417364, archiveDir=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/oldWALs, maxLogs=32 2023-02-12 12:03:38,702 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43309,DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd,DISK] 2023-02-12 12:03:38,702 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38407,DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2,DISK] 2023-02-12 12:03:38,704 INFO [RS:0;jenkins-hbase4:34761] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/WALs/jenkins-hbase4.apache.org,34761,1676203417364/jenkins-hbase4.apache.org%2C34761%2C1676203417364.1676203418690 2023-02-12 12:03:38,704 DEBUG [RS:0;jenkins-hbase4:34761] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43309,DS-b9971bfa-aec9-400e-b304-1488f5dbf7cd,DISK], DatanodeInfoWithStorage[127.0.0.1:38407,DS-8affdc9f-dffa-43f9-9d1a-f0a21eacf9c2,DISK]] 2023-02-12 12:03:38,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:38,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:38,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d5f7a8d106f32465f7904c7e950236e7, NAME => 'testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:38,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:38,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,784 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,785 DEBUG [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1 2023-02-12 12:03:38,785 DEBUG [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1 2023-02-12 12:03:38,785 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5f7a8d106f32465f7904c7e950236e7 columnFamilyName f1 2023-02-12 12:03:38,786 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(310): Store=d5f7a8d106f32465f7904c7e950236e7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:38,786 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,787 DEBUG [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2 2023-02-12 12:03:38,787 DEBUG [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2 2023-02-12 12:03:38,787 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5f7a8d106f32465f7904c7e950236e7 columnFamilyName f2 2023-02-12 12:03:38,787 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(310): Store=d5f7a8d106f32465f7904c7e950236e7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:38,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:38,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:38,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:38,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d5f7a8d106f32465f7904c7e950236e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59221813, jitterRate=-0.11752621829509735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:38,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d5f7a8d106f32465f7904c7e950236e7: Running coprocessor pre-open hook at 1676203418783Writing region info on filesystem at 1676203418783Initializing all the Stores at 1676203418784 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203418784Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203418784Cleaning up temporary data from old regions at 1676203418789 (+5 ms)Cleaning up detritus from prior splits at 1676203418789Running coprocessor post-open hooks at 1676203418792 (+3 ms)Region opened successfully at 1676203418792 2023-02-12 12:03:38,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7., pid=12, masterSystemTime=1676203418780 2023-02-12 12:03:38,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:38,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:38,795 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d5f7a8d106f32465f7904c7e950236e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:38,795 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676203418795"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203418795"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203418795"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203418795"}]},"ts":"1676203418795"} 2023-02-12 12:03:38,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 12:03:38,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure d5f7a8d106f32465f7904c7e950236e7, server=jenkins-hbase4.apache.org,37027,1676203417391 in 167 msec 2023-02-12 12:03:38,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 12:03:38,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d5f7a8d106f32465f7904c7e950236e7, ASSIGN in 323 msec 2023-02-12 12:03:38,799 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:38,799 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203418799"}]},"ts":"1676203418799"} 2023-02-12 12:03:38,800 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-12 12:03:38,802 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:38,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 360 msec 2023-02-12 12:03:39,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:39,049 INFO [Listener at localhost/35833] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-12 12:03:39,049 DEBUG [Listener at localhost/35833] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-12 12:03:39,049 INFO [Listener at localhost/35833] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:39,053 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-12 12:03:39,053 INFO [Listener at localhost/35833] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:39,053 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-12 12:03:39,053 INFO [Listener at localhost/35833] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 12:03:39,071 DEBUG [hconnection-0xc489a8-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:39,083 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36696, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:39,091 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37027] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,171 INFO [Listener at localhost/35833] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 12:03:39,171 INFO [Listener at localhost/35833] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 12:03:39,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 12:03:39,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676203419172 (current time:1676203419172). 2023-02-12 12:03:39,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 12:03:39,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] zookeeper.ReadOnlyZKClient(139): Connect 0x4bbd57af to 127.0.0.1:63498 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:39,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ec04080, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:39,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:39,177 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53046, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:39,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bbd57af to 127.0.0.1:63498 2023-02-12 12:03:39,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:39,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 12:03:39,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 12:03:39,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 12:03:39,182 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 12:03:39,182 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676204019182 2023-02-12 12:03:39,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 12:03:39,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,183 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 12:03:39,183 DEBUG [Listener at localhost/35833] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:39,184 DEBUG [Listener at localhost/35833] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 12:03:39,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 12:03:39,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 3 msec 2023-02-12 12:03:39,185 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 12:03:39,185 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676204019185 2023-02-12 12:03:39,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,193 INFO [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 12:03:39,193 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:39,194 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 12:03:39,194 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 12:03:39,194 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,194 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,196 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:39,196 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:39,196 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:39,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:39,196 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,196 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,198 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 12:03:39,198 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:39,198 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 12:03:39,198 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:39,198 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 12:03:39,199 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 12:03:39,199 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 12:03:39,199 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34761,1676203417364' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 12:03:39,199 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 12:03:39,199 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37027,1676203417391' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 12:03:39,201 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,201 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,201 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:39,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:39,201 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,201 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:39,202 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,202 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:39,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37027,1676203417391' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 12:03:39,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ac25225[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:39,203 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 12:03:39,203 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,204 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,204 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,204 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 12:03:39,204 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 12:03:39,204 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 12:03:39,204 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34761,1676203417364' in zk 2023-02-12 12:03:39,204 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,205 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:39,205 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 12:03:39,205 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:39,205 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,205 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. started... 2023-02-12 12:03:39,205 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d5f7a8d106f32465f7904c7e950236e7 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 12:03:39,207 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 12:03:39,207 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:39,207 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 12:03:39,226 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/.tmp/f1/87f7d01f507d49e48c716106a673cda3 2023-02-12 12:03:39,241 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/.tmp/f2/27768502470046629e80cd0df52c8d27 2023-02-12 12:03:39,245 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/.tmp/f1/87f7d01f507d49e48c716106a673cda3 as hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/87f7d01f507d49e48c716106a673cda3 2023-02-12 12:03:39,249 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/87f7d01f507d49e48c716106a673cda3, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 12:03:39,249 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/.tmp/f2/27768502470046629e80cd0df52c8d27 as hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/27768502470046629e80cd0df52c8d27 2023-02-12 12:03:39,252 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/27768502470046629e80cd0df52c8d27, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 12:03:39,253 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for d5f7a8d106f32465f7904c7e950236e7 in 48ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:39,253 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-12 12:03:39,254 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d5f7a8d106f32465f7904c7e950236e7: 2023-02-12 12:03:39,254 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,254 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:39,254 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/87f7d01f507d49e48c716106a673cda3] hfiles 2023-02-12 12:03:39,254 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/87f7d01f507d49e48c716106a673cda3 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,254 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/27768502470046629e80cd0df52c8d27] hfiles 2023-02-12 12:03:39,254 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/27768502470046629e80cd0df52c8d27 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,259 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. completed. 2023-02-12 12:03:39,259 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,259 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 12:03:39,259 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 12:03:39,259 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,259 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 12:03:39,259 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37027,1676203417391' in zk 2023-02-12 12:03:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 12:03:39,261 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 12:03:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37027,1676203417391': 2023-02-12 12:03:39,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37027,1676203417391' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 12:03:39,264 INFO [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 12:03:39,264 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:39,264 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:39,264 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,264 INFO [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 12:03:39,265 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,265 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,265 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,265 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,265 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,266 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:39,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:39,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:39,266 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,268 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:39,268 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:39,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:39,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,274 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:39,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:39,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:39,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,274 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:39,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:39,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,284 DEBUG [Listener at localhost/35833] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:39,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 12:03:39,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:39,285 DEBUG [Listener at localhost/35833] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 12:03:39,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,308 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-12 12:03:39,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,308 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676203419183Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676203419274 (+91 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676203419274Writing data manifest for testWithMockedMapReduceSingleRegion at 1676203419277 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676203419286 (+9 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676203419308 (+22 ms) 2023-02-12 12:03:39,310 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 12:03:39,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 127 msec 2023-02-12 12:03:39,485 DEBUG [Listener at localhost/35833] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:39,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 12:03:39,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 12:03:39,487 INFO [Listener at localhost/35833] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 12:03:39,491 INFO [Listener at localhost/35833] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 12:03:39,496 INFO [Listener at localhost/35833] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 12:03:39,524 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37027] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,602 INFO [Listener at localhost/35833] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 12:03:39,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 12:03:39,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,609 INFO [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 12:03:39,609 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:39,610 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 12:03:39,610 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 12:03:39,610 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,610 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,612 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,612 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:39,612 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:39,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:39,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:39,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:39,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:39,612 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,612 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:39,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:39,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,613 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:39,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,613 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,613 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,613 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 12:03:39,613 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:39,617 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 12:03:39,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,617 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 12:03:39,617 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:39,617 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,617 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. started... 2023-02-12 12:03:39,617 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d5f7a8d106f32465f7904c7e950236e7 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 12:03:39,621 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 12:03:39,621 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:39,621 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 12:03:39,621 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 12:03:39,621 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34761,1676203417364' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 12:03:39,623 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,623 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,623 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:39,636 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/.tmp/f1/3cbc1f47923b4a219b4f9c4a6af65cf8 2023-02-12 12:03:39,653 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/.tmp/f2/e7dfbfb8d8d94e51b469da3e5564a9b5 2023-02-12 12:03:39,658 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/.tmp/f1/3cbc1f47923b4a219b4f9c4a6af65cf8 as hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/3cbc1f47923b4a219b4f9c4a6af65cf8 2023-02-12 12:03:39,662 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/3cbc1f47923b4a219b4f9c4a6af65cf8, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 12:03:39,663 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/.tmp/f2/e7dfbfb8d8d94e51b469da3e5564a9b5 as hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/e7dfbfb8d8d94e51b469da3e5564a9b5 2023-02-12 12:03:39,669 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/e7dfbfb8d8d94e51b469da3e5564a9b5, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 12:03:39,670 INFO [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for d5f7a8d106f32465f7904c7e950236e7 in 53ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:39,671 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d5f7a8d106f32465f7904c7e950236e7: 2023-02-12 12:03:39,671 DEBUG [rs(jenkins-hbase4.apache.org,37027,1676203417391)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,671 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 12:03:39,671 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 12:03:39,671 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,671 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 12:03:39,671 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37027,1676203417391' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 12:03:39,672 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,672 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:39,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:39,673 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,673 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:39,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:39,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:39,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:39,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37027,1676203417391' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 12:03:39,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2efdd3a5[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:39,675 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 12:03:39,675 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,677 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,677 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 12:03:39,677 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,677 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 12:03:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 12:03:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34761,1676203417364' in zk 2023-02-12 12:03:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 12:03:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37027,1676203417391' in zk 2023-02-12 12:03:39,678 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 12:03:39,678 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:39,678 DEBUG [member: 'jenkins-hbase4.apache.org,34761,1676203417364' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 12:03:39,679 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 12:03:39,679 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,679 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:39,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:39,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:39,679 DEBUG [member: 'jenkins-hbase4.apache.org,37027,1676203417391' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 12:03:39,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:39,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:39,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:39,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37027,1676203417391': 2023-02-12 12:03:39,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37027,1676203417391' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 12:03:39,682 INFO [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 12:03:39,682 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:39,682 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:39,682 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,682 INFO [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 12:03:39,684 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,684 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:39,684 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:39,684 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,684 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:39,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:39,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,685 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,685 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,687 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,687 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,690 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:39,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-12 12:03:39,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 12:03:39,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:39,691 DEBUG [(jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:39,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:39,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 12:03:39,691 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,692 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:39,692 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,692 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,804 DEBUG [Listener at localhost/35833] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 12:03:39,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 12:03:39,810 INFO [Listener at localhost/35833] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676203419172 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:39,810 DEBUG [Listener at localhost/35833] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40673/user/jenkins/test-data/666d3832-c274-6952-5c8b-42c837cc05d8/testWithMockedMapReduceSingleRegion/5c6763fa-d133-4c32-91d5-807e0c6da7cc/data/default/testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,810 INFO [Listener at localhost/35833] snapshot.RestoreSnapshotHelper(239): region to add: d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:39,810 INFO [Listener at localhost/35833] snapshot.RestoreSnapshotHelper(585): clone region=d5f7a8d106f32465f7904c7e950236e7 as d5f7a8d106f32465f7904c7e950236e7 in snapshot testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,811 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d5f7a8d106f32465f7904c7e950236e7, NAME => 'testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40673/user/jenkins/test-data/666d3832-c274-6952-5c8b-42c837cc05d8/testWithMockedMapReduceSingleRegion/5c6763fa-d133-4c32-91d5-807e0c6da7cc 2023-02-12 12:03:39,821 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:39,821 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 87f7d01f507d49e48c716106a673cda3 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,823 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 27768502470046629e80cd0df52c8d27 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,826 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d5f7a8d106f32465f7904c7e950236e7, disabling compactions & flushes 2023-02-12 12:03:39,826 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,826 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,826 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. after waiting 0 ms 2023-02-12 12:03:39,826 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,826 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,826 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d5f7a8d106f32465f7904c7e950236e7: Waiting for close lock at 1676203419826Disabling compacts and flushes for region at 1676203419826Disabling writes for close at 1676203419826Writing region close event to WAL at 1676203419826Closed at 1676203419826 2023-02-12 12:03:39,826 INFO [Listener at localhost/35833] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676203419172 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:39,826 DEBUG [Listener at localhost/35833] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40673/user/jenkins/test-data/666d3832-c274-6952-5c8b-42c837cc05d8/testWithMockedMapReduceSingleRegion/5c6763fa-d133-4c32-91d5-807e0c6da7cc 2023-02-12 12:03:39,826 DEBUG [Listener at localhost/35833] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40673/user/jenkins/test-data/666d3832-c274-6952-5c8b-42c837cc05d8/testWithMockedMapReduceSingleRegion/5c6763fa-d133-4c32-91d5-807e0c6da7cc 2023-02-12 12:03:39,827 DEBUG [Listener at localhost/35833] util.CommonFSUtils(699): |-data/ 2023-02-12 12:03:39,827 DEBUG [Listener at localhost/35833] util.CommonFSUtils(699): |----default/ 2023-02-12 12:03:39,828 DEBUG [Listener at localhost/35833] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-12 12:03:39,828 DEBUG [Listener at localhost/35833] util.CommonFSUtils(699): |----------d5f7a8d106f32465f7904c7e950236e7/ 2023-02-12 12:03:39,828 DEBUG [Listener at localhost/35833] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:39,829 DEBUG [Listener at localhost/35833] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:39,829 DEBUG [Listener at localhost/35833] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=d5f7a8d106f32465f7904c7e950236e7-87f7d01f507d49e48c716106a673cda3 2023-02-12 12:03:39,829 DEBUG [Listener at localhost/35833] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:39,829 DEBUG [Listener at localhost/35833] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=d5f7a8d106f32465f7904c7e950236e7-27768502470046629e80cd0df52c8d27 2023-02-12 12:03:39,832 INFO [Listener at localhost/35833] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 12:03:39,836 DEBUG [Listener at localhost/35833] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:39,836 INFO [Listener at localhost/35833] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:39,836 DEBUG [Listener at localhost/35833] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:39,839 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:39,839 DEBUG [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/666d3832-c274-6952-5c8b-42c837cc05d8/testWithMockedMapReduceSingleRegion/5c6763fa-d133-4c32-91d5-807e0c6da7cc/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1 2023-02-12 12:03:39,840 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5f7a8d106f32465f7904c7e950236e7 columnFamilyName f1 2023-02-12 12:03:39,843 DEBUG [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(539): loaded hdfs://localhost:40673/user/jenkins/test-data/666d3832-c274-6952-5c8b-42c837cc05d8/testWithMockedMapReduceSingleRegion/5c6763fa-d133-4c32-91d5-807e0c6da7cc/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/testWithMockedMapReduceSingleRegion=d5f7a8d106f32465f7904c7e950236e7-87f7d01f507d49e48c716106a673cda3 2023-02-12 12:03:39,843 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(310): Store=d5f7a8d106f32465f7904c7e950236e7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:39,843 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:39,844 DEBUG [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40673/user/jenkins/test-data/666d3832-c274-6952-5c8b-42c837cc05d8/testWithMockedMapReduceSingleRegion/5c6763fa-d133-4c32-91d5-807e0c6da7cc/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2 2023-02-12 12:03:39,844 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5f7a8d106f32465f7904c7e950236e7 columnFamilyName f2 2023-02-12 12:03:39,847 DEBUG [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(539): loaded hdfs://localhost:40673/user/jenkins/test-data/666d3832-c274-6952-5c8b-42c837cc05d8/testWithMockedMapReduceSingleRegion/5c6763fa-d133-4c32-91d5-807e0c6da7cc/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/testWithMockedMapReduceSingleRegion=d5f7a8d106f32465f7904c7e950236e7-27768502470046629e80cd0df52c8d27 2023-02-12 12:03:39,847 INFO [StoreOpener-d5f7a8d106f32465f7904c7e950236e7-1] regionserver.HStore(310): Store=d5f7a8d106f32465f7904c7e950236e7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:39,847 DEBUG [Listener at localhost/35833] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:39,848 INFO [Listener at localhost/35833] regionserver.HRegion(1071): Opened d5f7a8d106f32465f7904c7e950236e7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64315823, jitterRate=-0.04161955416202545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:39,848 DEBUG [Listener at localhost/35833] regionserver.HRegion(964): Region open journal for d5f7a8d106f32465f7904c7e950236e7: Writing region info on filesystem at 1676203419837Initializing all the Stores at 1676203419837Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203419837Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203419837Region opened successfully at 1676203419848 (+11 ms) 2023-02-12 12:03:39,892 DEBUG [Listener at localhost/35833] regionserver.HRegion(1603): Closing d5f7a8d106f32465f7904c7e950236e7, disabling compactions & flushes 2023-02-12 12:03:39,892 INFO [Listener at localhost/35833] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,893 DEBUG [Listener at localhost/35833] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,893 DEBUG [Listener at localhost/35833] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. after waiting 0 ms 2023-02-12 12:03:39,893 DEBUG [Listener at localhost/35833] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,893 INFO [Listener at localhost/35833] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:39,893 DEBUG [Listener at localhost/35833] regionserver.HRegion(1557): Region close journal for d5f7a8d106f32465f7904c7e950236e7: Waiting for close lock at 1676203419892Disabling compacts and flushes for region at 1676203419892Disabling writes for close at 1676203419893 (+1 ms)Writing region close event to WAL at 1676203419893Closed at 1676203419893 2023-02-12 12:03:39,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-12 12:03:39,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,901 INFO [Listener at localhost/35833] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:39,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:39,908 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203419908"}]},"ts":"1676203419908"} 2023-02-12 12:03:39,909 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-12 12:03:39,911 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-12 12:03:39,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d5f7a8d106f32465f7904c7e950236e7, UNASSIGN}] 2023-02-12 12:03:39,914 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d5f7a8d106f32465f7904c7e950236e7, UNASSIGN 2023-02-12 12:03:39,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d5f7a8d106f32465f7904c7e950236e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:39,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676203419915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203419915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203419915"}]},"ts":"1676203419915"} 2023-02-12 12:03:39,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure d5f7a8d106f32465f7904c7e950236e7, server=jenkins-hbase4.apache.org,37027,1676203417391}] 2023-02-12 12:03:40,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:40,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:40,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d5f7a8d106f32465f7904c7e950236e7, disabling compactions & flushes 2023-02-12 12:03:40,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:40,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:40,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. after waiting 0 ms 2023-02-12 12:03:40,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:40,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:40,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7. 2023-02-12 12:03:40,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d5f7a8d106f32465f7904c7e950236e7: Waiting for close lock at 1676203420069Running coprocessor pre-close hooks at 1676203420069Disabling compacts and flushes for region at 1676203420069Disabling writes for close at 1676203420069Writing region close event to WAL at 1676203420070 (+1 ms)Running coprocessor post-close hooks at 1676203420073 (+3 ms)Closed at 1676203420073 2023-02-12 12:03:40,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:40,075 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d5f7a8d106f32465f7904c7e950236e7, regionState=CLOSED 2023-02-12 12:03:40,075 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676203420075"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203420075"}]},"ts":"1676203420075"} 2023-02-12 12:03:40,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 12:03:40,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure d5f7a8d106f32465f7904c7e950236e7, server=jenkins-hbase4.apache.org,37027,1676203417391 in 160 msec 2023-02-12 12:03:40,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 12:03:40,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d5f7a8d106f32465f7904c7e950236e7, UNASSIGN in 166 msec 2023-02-12 12:03:40,079 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203420079"}]},"ts":"1676203420079"} 2023-02-12 12:03:40,080 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-12 12:03:40,081 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-12 12:03:40,082 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 179 msec 2023-02-12 12:03:40,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:40,209 INFO [Listener at localhost/35833] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-12 12:03:40,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-12 12:03:40,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:40,211 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:40,212 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:40,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 12:03:40,215 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:40,216 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1, FileablePath, hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2, FileablePath, hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/recovered.edits] 2023-02-12 12:03:40,218 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/3cbc1f47923b4a219b4f9c4a6af65cf8 to hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/archive/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/3cbc1f47923b4a219b4f9c4a6af65cf8 2023-02-12 12:03:40,219 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/87f7d01f507d49e48c716106a673cda3 to hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/archive/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f1/87f7d01f507d49e48c716106a673cda3 2023-02-12 12:03:40,221 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/27768502470046629e80cd0df52c8d27 to hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/archive/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/27768502470046629e80cd0df52c8d27 2023-02-12 12:03:40,222 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/e7dfbfb8d8d94e51b469da3e5564a9b5 to hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/archive/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/f2/e7dfbfb8d8d94e51b469da3e5564a9b5 2023-02-12 12:03:40,224 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/recovered.edits/12.seqid to hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/archive/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7/recovered.edits/12.seqid 2023-02-12 12:03:40,225 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/.tmp/data/default/testWithMockedMapReduceSingleRegion/d5f7a8d106f32465f7904c7e950236e7 2023-02-12 12:03:40,225 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 12:03:40,226 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:40,228 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-12 12:03:40,229 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-12 12:03:40,230 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:40,230 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-12 12:03:40,230 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203420230"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:40,231 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 12:03:40,231 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d5f7a8d106f32465f7904c7e950236e7, NAME => 'testWithMockedMapReduceSingleRegion,,1676203418441.d5f7a8d106f32465f7904c7e950236e7.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 12:03:40,231 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-12 12:03:40,231 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676203420231"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:40,232 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-12 12:03:40,234 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 12:03:40,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 24 msec 2023-02-12 12:03:40,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42059] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 12:03:40,314 INFO [Listener at localhost/35833] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-12 12:03:40,314 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 12:03:40,314 INFO [Listener at localhost/35833] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 12:03:40,314 DEBUG [Listener at localhost/35833] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7623abee to 127.0.0.1:63498 2023-02-12 12:03:40,314 DEBUG [Listener at localhost/35833] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:40,314 DEBUG [Listener at localhost/35833] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 12:03:40,315 DEBUG [Listener at localhost/35833] util.JVMClusterUtil(257): Found active master hash=1447330495, stopped=false 2023-02-12 12:03:40,315 INFO [Listener at localhost/35833] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:40,317 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:40,317 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:40,317 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:40,317 INFO [Listener at localhost/35833] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 12:03:40,317 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:40,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:40,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:40,319 DEBUG [Listener at localhost/35833] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x643557ac to 127.0.0.1:63498 2023-02-12 12:03:40,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:40,319 DEBUG [Listener at localhost/35833] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:40,319 INFO [Listener at localhost/35833] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34761,1676203417364' ***** 2023-02-12 12:03:40,319 INFO [Listener at localhost/35833] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:40,319 INFO [Listener at localhost/35833] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37027,1676203417391' ***** 2023-02-12 12:03:40,319 INFO [Listener at localhost/35833] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:40,319 INFO [RS:1;jenkins-hbase4:37027] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:40,319 INFO [RS:0;jenkins-hbase4:34761] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:40,319 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:40,319 INFO [RS:1;jenkins-hbase4:37027] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:40,319 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:40,320 INFO [RS:1;jenkins-hbase4:37027] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:40,319 INFO [RS:0;jenkins-hbase4:34761] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:40,321 INFO [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(3304): Received CLOSE for 6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:40,321 INFO [RS:0;jenkins-hbase4:34761] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:40,321 INFO [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:40,321 INFO [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:40,321 DEBUG [RS:1;jenkins-hbase4:37027] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5062eed9 to 127.0.0.1:63498 2023-02-12 12:03:40,321 DEBUG [RS:0;jenkins-hbase4:34761] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e78f5b4 to 127.0.0.1:63498 2023-02-12 12:03:40,321 DEBUG [RS:0;jenkins-hbase4:34761] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:40,321 INFO [RS:0;jenkins-hbase4:34761] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:40,321 INFO [RS:0;jenkins-hbase4:34761] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:40,321 INFO [RS:0;jenkins-hbase4:34761] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:40,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6ae9adf3e18b7013251506ca6d68f667, disabling compactions & flushes 2023-02-12 12:03:40,321 INFO [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 12:03:40,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:40,321 DEBUG [RS:1;jenkins-hbase4:37027] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:40,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:40,321 INFO [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 12:03:40,321 INFO [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 12:03:40,321 DEBUG [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1479): Online Regions={6ae9adf3e18b7013251506ca6d68f667=hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667.} 2023-02-12 12:03:40,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. after waiting 0 ms 2023-02-12 12:03:40,322 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:40,322 DEBUG [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 12:03:40,322 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:40,322 DEBUG [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:40,322 DEBUG [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1505): Waiting on 6ae9adf3e18b7013251506ca6d68f667 2023-02-12 12:03:40,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:40,322 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:40,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 6ae9adf3e18b7013251506ca6d68f667 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 12:03:40,322 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:40,322 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:40,322 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-12 12:03:40,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667/.tmp/info/cd4a2a572fc948318164194992b3fad0 2023-02-12 12:03:40,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/.tmp/info/0973d3cc2f284e96b37ba358e65339a3 2023-02-12 12:03:40,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0973d3cc2f284e96b37ba358e65339a3 2023-02-12 12:03:40,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667/.tmp/info/cd4a2a572fc948318164194992b3fad0 as hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667/info/cd4a2a572fc948318164194992b3fad0 2023-02-12 12:03:40,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667/info/cd4a2a572fc948318164194992b3fad0, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 12:03:40,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6ae9adf3e18b7013251506ca6d68f667 in 20ms, sequenceid=6, compaction requested=false 2023-02-12 12:03:40,347 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/.tmp/rep_barrier/39da5919ca8e49e098d57ef3faa9a315 2023-02-12 12:03:40,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/namespace/6ae9adf3e18b7013251506ca6d68f667/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 12:03:40,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:40,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6ae9adf3e18b7013251506ca6d68f667: Waiting for close lock at 1676203420321Running coprocessor pre-close hooks at 1676203420321Disabling compacts and flushes for region at 1676203420321Disabling writes for close at 1676203420322 (+1 ms)Obtaining lock to block concurrent updates at 1676203420322Preparing flush snapshotting stores in 6ae9adf3e18b7013251506ca6d68f667 at 1676203420322Finished memstore snapshotting hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676203420322Flushing stores of hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. at 1676203420322Flushing 6ae9adf3e18b7013251506ca6d68f667/info: creating writer at 1676203420323 (+1 ms)Flushing 6ae9adf3e18b7013251506ca6d68f667/info: appending metadata at 1676203420324 (+1 ms)Flushing 6ae9adf3e18b7013251506ca6d68f667/info: closing flushed file at 1676203420324Flushing 6ae9adf3e18b7013251506ca6d68f667/info: reopening flushed file at 1676203420338 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 6ae9adf3e18b7013251506ca6d68f667 in 20ms, sequenceid=6, compaction requested=false at 1676203420342 (+4 ms)Writing region close event to WAL at 1676203420346 (+4 ms)Running coprocessor post-close hooks at 1676203420349 (+3 ms)Closed at 1676203420349 2023-02-12 12:03:40,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676203417943.6ae9adf3e18b7013251506ca6d68f667. 2023-02-12 12:03:40,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 39da5919ca8e49e098d57ef3faa9a315 2023-02-12 12:03:40,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/.tmp/table/1f82b91942594744b0426da30d8a562a 2023-02-12 12:03:40,365 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f82b91942594744b0426da30d8a562a 2023-02-12 12:03:40,365 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/.tmp/info/0973d3cc2f284e96b37ba358e65339a3 as hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/info/0973d3cc2f284e96b37ba358e65339a3 2023-02-12 12:03:40,367 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:40,370 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0973d3cc2f284e96b37ba358e65339a3 2023-02-12 12:03:40,370 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/info/0973d3cc2f284e96b37ba358e65339a3, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 12:03:40,371 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/.tmp/rep_barrier/39da5919ca8e49e098d57ef3faa9a315 as hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/rep_barrier/39da5919ca8e49e098d57ef3faa9a315 2023-02-12 12:03:40,374 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 39da5919ca8e49e098d57ef3faa9a315 2023-02-12 12:03:40,375 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/rep_barrier/39da5919ca8e49e098d57ef3faa9a315, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 12:03:40,375 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:40,376 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/.tmp/table/1f82b91942594744b0426da30d8a562a as hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/table/1f82b91942594744b0426da30d8a562a 2023-02-12 12:03:40,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f82b91942594744b0426da30d8a562a 2023-02-12 12:03:40,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/table/1f82b91942594744b0426da30d8a562a, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 12:03:40,383 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 61ms, sequenceid=21, compaction requested=false 2023-02-12 12:03:40,386 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 12:03:40,387 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:40,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:40,387 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203420322Running coprocessor pre-close hooks at 1676203420322Disabling compacts and flushes for region at 1676203420322Disabling writes for close at 1676203420322Obtaining lock to block concurrent updates at 1676203420322Preparing flush snapshotting stores in 1588230740 at 1676203420322Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676203420322Flushing stores of hbase:meta,,1.1588230740 at 1676203420323 (+1 ms)Flushing 1588230740/info: creating writer at 1676203420323Flushing 1588230740/info: appending metadata at 1676203420325 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676203420325Flushing 1588230740/rep_barrier: creating writer at 1676203420335 (+10 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676203420339 (+4 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676203420339Flushing 1588230740/table: creating writer at 1676203420351 (+12 ms)Flushing 1588230740/table: appending metadata at 1676203420353 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676203420353Flushing 1588230740/info: reopening flushed file at 1676203420366 (+13 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676203420371 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676203420377 (+6 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 61ms, sequenceid=21, compaction requested=false at 1676203420383 (+6 ms)Writing region close event to WAL at 1676203420384 (+1 ms)Running coprocessor post-close hooks at 1676203420387 (+3 ms)Closed at 1676203420387 2023-02-12 12:03:40,387 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:40,522 INFO [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34761,1676203417364; all regions closed. 2023-02-12 12:03:40,522 INFO [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37027,1676203417391; all regions closed. 2023-02-12 12:03:40,526 DEBUG [RS:1;jenkins-hbase4:37027] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/oldWALs 2023-02-12 12:03:40,526 DEBUG [RS:0;jenkins-hbase4:34761] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/oldWALs 2023-02-12 12:03:40,526 INFO [RS:0;jenkins-hbase4:34761] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34761%2C1676203417364.meta:.meta(num 1676203417894) 2023-02-12 12:03:40,526 INFO [RS:1;jenkins-hbase4:37027] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37027%2C1676203417391:(num 1676203418286) 2023-02-12 12:03:40,526 DEBUG [RS:1;jenkins-hbase4:37027] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:40,526 INFO [RS:1;jenkins-hbase4:37027] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:40,527 INFO [RS:1;jenkins-hbase4:37027] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:40,527 INFO [RS:1;jenkins-hbase4:37027] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:40,527 INFO [RS:1;jenkins-hbase4:37027] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:40,527 INFO [RS:1;jenkins-hbase4:37027] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:40,527 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:40,528 INFO [RS:1;jenkins-hbase4:37027] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37027 2023-02-12 12:03:40,530 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:40,530 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:40,530 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:40,530 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37027,1676203417391 2023-02-12 12:03:40,530 ERROR [Listener at localhost/35833-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67fdefb7 rejected from java.util.concurrent.ThreadPoolExecutor@63c26790[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:40,530 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:40,530 ERROR [Listener at localhost/35833-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1fa4b0b8 rejected from java.util.concurrent.ThreadPoolExecutor@63c26790[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:40,531 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37027,1676203417391] 2023-02-12 12:03:40,531 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37027,1676203417391; numProcessing=1 2023-02-12 12:03:40,531 DEBUG [RS:0;jenkins-hbase4:34761] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/oldWALs 2023-02-12 12:03:40,531 INFO [RS:0;jenkins-hbase4:34761] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34761%2C1676203417364:(num 1676203418690) 2023-02-12 12:03:40,531 DEBUG [RS:0;jenkins-hbase4:34761] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:40,531 INFO [RS:0;jenkins-hbase4:34761] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:40,531 INFO [RS:0;jenkins-hbase4:34761] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:40,531 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:40,532 INFO [RS:0;jenkins-hbase4:34761] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34761 2023-02-12 12:03:40,533 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37027,1676203417391 already deleted, retry=false 2023-02-12 12:03:40,533 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37027,1676203417391 expired; onlineServers=1 2023-02-12 12:03:40,534 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:40,534 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34761,1676203417364 2023-02-12 12:03:40,534 ERROR [Listener at localhost/35833-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7041414e rejected from java.util.concurrent.ThreadPoolExecutor@747edb9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:40,534 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34761,1676203417364] 2023-02-12 12:03:40,534 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34761,1676203417364; numProcessing=2 2023-02-12 12:03:40,537 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34761,1676203417364 already deleted, retry=false 2023-02-12 12:03:40,537 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34761,1676203417364 expired; onlineServers=0 2023-02-12 12:03:40,537 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42059,1676203417322' ***** 2023-02-12 12:03:40,537 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 12:03:40,537 DEBUG [M:0;jenkins-hbase4:42059] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@527b1caf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:40,538 INFO [M:0;jenkins-hbase4:42059] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42059,1676203417322 2023-02-12 12:03:40,538 INFO [M:0;jenkins-hbase4:42059] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42059,1676203417322; all regions closed. 2023-02-12 12:03:40,538 DEBUG [M:0;jenkins-hbase4:42059] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:40,538 DEBUG [M:0;jenkins-hbase4:42059] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 12:03:40,538 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 12:03:40,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203417544] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203417544,5,FailOnTimeoutGroup] 2023-02-12 12:03:40,538 DEBUG [M:0;jenkins-hbase4:42059] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 12:03:40,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203417544] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203417544,5,FailOnTimeoutGroup] 2023-02-12 12:03:40,539 INFO [M:0;jenkins-hbase4:42059] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 12:03:40,539 INFO [M:0;jenkins-hbase4:42059] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 12:03:40,539 INFO [M:0;jenkins-hbase4:42059] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 12:03:40,539 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:40,539 DEBUG [M:0;jenkins-hbase4:42059] master.HMaster(1502): Stopping service threads 2023-02-12 12:03:40,539 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:40,539 INFO [M:0;jenkins-hbase4:42059] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 12:03:40,540 ERROR [M:0;jenkins-hbase4:42059] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 12:03:40,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:40,540 INFO [M:0;jenkins-hbase4:42059] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 12:03:40,540 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 12:03:40,541 DEBUG [M:0;jenkins-hbase4:42059] zookeeper.ZKUtil(398): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 12:03:40,541 WARN [M:0;jenkins-hbase4:42059] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 12:03:40,541 INFO [M:0;jenkins-hbase4:42059] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 12:03:40,541 INFO [M:0;jenkins-hbase4:42059] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 12:03:40,541 DEBUG [M:0;jenkins-hbase4:42059] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:40,541 INFO [M:0;jenkins-hbase4:42059] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:40,541 DEBUG [M:0;jenkins-hbase4:42059] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:40,541 DEBUG [M:0;jenkins-hbase4:42059] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:40,541 DEBUG [M:0;jenkins-hbase4:42059] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:40,541 INFO [M:0;jenkins-hbase4:42059] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.12 KB heapSize=67.06 KB 2023-02-12 12:03:40,550 INFO [M:0;jenkins-hbase4:42059] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.12 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/eb7cacbc711d402ba2ea11ba96496cca 2023-02-12 12:03:40,554 DEBUG [M:0;jenkins-hbase4:42059] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/eb7cacbc711d402ba2ea11ba96496cca as hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/eb7cacbc711d402ba2ea11ba96496cca 2023-02-12 12:03:40,557 INFO [M:0;jenkins-hbase4:42059] regionserver.HStore(1080): Added hdfs://localhost:40673/user/jenkins/test-data/6bb9d487-b53e-3911-2b82-afec79422666/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/eb7cacbc711d402ba2ea11ba96496cca, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 12:03:40,558 INFO [M:0;jenkins-hbase4:42059] regionserver.HRegion(2947): Finished flush of dataSize ~56.12 KB/57462, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-12 12:03:40,558 INFO [M:0;jenkins-hbase4:42059] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:40,558 DEBUG [M:0;jenkins-hbase4:42059] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203420541Disabling compacts and flushes for region at 1676203420541Disabling writes for close at 1676203420541Obtaining lock to block concurrent updates at 1676203420541Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676203420541Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57462, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676203420542 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676203420542Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676203420543 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676203420545 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676203420545Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676203420554 (+9 ms)Finished flush of dataSize ~56.12 KB/57462, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1676203420558 (+4 ms)Writing region close event to WAL at 1676203420558Closed at 1676203420558 2023-02-12 12:03:40,562 INFO [M:0;jenkins-hbase4:42059] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 12:03:40,562 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:40,563 INFO [M:0;jenkins-hbase4:42059] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42059 2023-02-12 12:03:40,564 DEBUG [M:0;jenkins-hbase4:42059] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42059,1676203417322 already deleted, retry=false 2023-02-12 12:03:40,819 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:40,819 INFO [M:0;jenkins-hbase4:42059] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42059,1676203417322; zookeeper connection closed. 2023-02-12 12:03:40,819 ERROR [Listener at localhost/35833-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@792214f2 rejected from java.util.concurrent.ThreadPoolExecutor@7d1d9f0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:40,820 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): master:42059-0x100486a489d0000, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:40,820 ERROR [Listener at localhost/35833-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60815bb0 rejected from java.util.concurrent.ThreadPoolExecutor@7d1d9f0e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:40,919 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:40,919 INFO [RS:0;jenkins-hbase4:34761] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34761,1676203417364; zookeeper connection closed. 2023-02-12 12:03:40,920 ERROR [Listener at localhost/35833-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a369c74 rejected from java.util.concurrent.ThreadPoolExecutor@747edb9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:40,920 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:34761-0x100486a489d0001, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:40,920 ERROR [Listener at localhost/35833-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22770e8 rejected from java.util.concurrent.ThreadPoolExecutor@747edb9e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:40,920 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1662a034] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1662a034 2023-02-12 12:03:41,020 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:41,020 INFO [RS:1;jenkins-hbase4:37027] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37027,1676203417391; zookeeper connection closed. 2023-02-12 12:03:41,020 ERROR [Listener at localhost/35833-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67226f2e rejected from java.util.concurrent.ThreadPoolExecutor@63c26790[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:41,020 DEBUG [Listener at localhost/35833-EventThread] zookeeper.ZKWatcher(600): regionserver:37027-0x100486a489d0002, quorum=127.0.0.1:63498, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:41,020 ERROR [Listener at localhost/35833-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7cf453d6 rejected from java.util.concurrent.ThreadPoolExecutor@63c26790[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:41,020 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2ab7d66c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2ab7d66c 2023-02-12 12:03:41,021 INFO [Listener at localhost/35833] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 12:03:41,021 WARN [Listener at localhost/35833] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:41,024 INFO [Listener at localhost/35833] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:41,129 WARN [BP-1092537995-172.31.14.131-1676203416685 heartbeating to localhost/127.0.0.1:40673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:41,130 WARN [BP-1092537995-172.31.14.131-1676203416685 heartbeating to localhost/127.0.0.1:40673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1092537995-172.31.14.131-1676203416685 (Datanode Uuid dfe769f0-fff9-40fa-a373-1ae5964d9bc7) service to localhost/127.0.0.1:40673 2023-02-12 12:03:41,130 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/cluster_aa5ee910-e16a-cf94-3562-33f4840f97f4/dfs/data/data3/current/BP-1092537995-172.31.14.131-1676203416685] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:41,131 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/cluster_aa5ee910-e16a-cf94-3562-33f4840f97f4/dfs/data/data4/current/BP-1092537995-172.31.14.131-1676203416685] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:41,131 WARN [Listener at localhost/35833] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:41,135 INFO [Listener at localhost/35833] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:41,240 WARN [BP-1092537995-172.31.14.131-1676203416685 heartbeating to localhost/127.0.0.1:40673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:41,240 WARN [BP-1092537995-172.31.14.131-1676203416685 heartbeating to localhost/127.0.0.1:40673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1092537995-172.31.14.131-1676203416685 (Datanode Uuid b8bd1c86-ea49-4610-a262-311ece067b2f) service to localhost/127.0.0.1:40673 2023-02-12 12:03:41,241 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/cluster_aa5ee910-e16a-cf94-3562-33f4840f97f4/dfs/data/data1/current/BP-1092537995-172.31.14.131-1676203416685] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:41,241 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/cluster_aa5ee910-e16a-cf94-3562-33f4840f97f4/dfs/data/data2/current/BP-1092537995-172.31.14.131-1676203416685] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:41,250 INFO [Listener at localhost/35833] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:41,363 INFO [Listener at localhost/35833] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 12:03:41,376 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 12:03:41,388 INFO [Listener at localhost/35833] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 229) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35833.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35833 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:40673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42059,1676203417322)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40673 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40673 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:40673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:40673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=652 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=296 (was 313), ProcessCount=166 (was 166), AvailableMemoryMB=3959 (was 3990) 2023-02-12 12:03:41,398 INFO [Listener at localhost/35833] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=296, ProcessCount=166, AvailableMemoryMB=3959 2023-02-12 12:03:41,408 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/hadoop.log.dir so I do NOT create it in target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a 2023-02-12 12:03:41,408 WARN [Listener at localhost/35833] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 12:03:41,408 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/hadoop.tmp.dir so I do NOT create it in target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a 2023-02-12 12:03:41,408 WARN [Listener at localhost/35833] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b1e7dd99-4fbc-6925-2a1e-a609016ce26e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 12:03:41,408 DEBUG [Listener at localhost/35833] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a 2023-02-12 12:03:41,408 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 12:03:41,409 INFO [Listener at localhost/35833] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/cluster_2611dbbe-8ccc-905a-d076-c9b47b6c49c9, deleteOnExit=true 2023-02-12 12:03:41,409 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 12:03:41,409 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/test.cache.data in system properties and HBase conf 2023-02-12 12:03:41,409 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 12:03:41,409 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/hadoop.log.dir in system properties and HBase conf 2023-02-12 12:03:41,409 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 12:03:41,409 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 12:03:41,409 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 12:03:41,409 DEBUG [Listener at localhost/35833] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/nfs.dump.dir in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/java.io.tmpdir in system properties and HBase conf 2023-02-12 12:03:41,410 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:41,411 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 12:03:41,411 INFO [Listener at localhost/35833] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 12:03:41,415 WARN [Listener at localhost/35833] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:41,415 WARN [Listener at localhost/35833] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:41,455 WARN [Listener at localhost/35833] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:41,456 INFO [Listener at localhost/35833] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:41,461 INFO [Listener at localhost/35833] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/java.io.tmpdir/Jetty_localhost_39231_hdfs____.ugife4/webapp 2023-02-12 12:03:41,553 INFO [Listener at localhost/35833] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39231 2023-02-12 12:03:41,557 WARN [Listener at localhost/35833] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:41,557 WARN [Listener at localhost/35833] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:41,600 WARN [Listener at localhost/45319] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:41,615 WARN [Listener at localhost/45319] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:41,620 WARN [Listener at localhost/45319] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:41,621 INFO [Listener at localhost/45319] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:41,625 INFO [Listener at localhost/45319] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/java.io.tmpdir/Jetty_localhost_40417_datanode____.hn7wb/webapp 2023-02-12 12:03:41,716 INFO [Listener at localhost/45319] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40417 2023-02-12 12:03:41,723 WARN [Listener at localhost/44061] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:41,738 WARN [Listener at localhost/44061] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:41,741 WARN [Listener at localhost/44061] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:41,742 INFO [Listener at localhost/44061] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:41,747 INFO [Listener at localhost/44061] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/java.io.tmpdir/Jetty_localhost_41653_datanode____qw9gym/webapp 2023-02-12 12:03:41,813 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x33b049e3a40fd3de: Processing first storage report for DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d from datanode 52a73509-8428-4b46-9688-c51b21161038 2023-02-12 12:03:41,813 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x33b049e3a40fd3de: from storage DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d node DatanodeRegistration(127.0.0.1:45465, datanodeUuid=52a73509-8428-4b46-9688-c51b21161038, infoPort=43551, infoSecurePort=0, ipcPort=44061, storageInfo=lv=-57;cid=testClusterID;nsid=1832001149;c=1676203421417), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:41,813 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x33b049e3a40fd3de: Processing first storage report for DS-15854425-2164-4e7f-9965-e1d6ca12b2d0 from datanode 52a73509-8428-4b46-9688-c51b21161038 2023-02-12 12:03:41,813 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x33b049e3a40fd3de: from storage DS-15854425-2164-4e7f-9965-e1d6ca12b2d0 node DatanodeRegistration(127.0.0.1:45465, datanodeUuid=52a73509-8428-4b46-9688-c51b21161038, infoPort=43551, infoSecurePort=0, ipcPort=44061, storageInfo=lv=-57;cid=testClusterID;nsid=1832001149;c=1676203421417), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:41,852 INFO [Listener at localhost/44061] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41653 2023-02-12 12:03:41,859 WARN [Listener at localhost/32779] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:41,955 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x889b43d816774e7d: Processing first storage report for DS-de7a25bb-3635-47e6-863e-4b6d33f122e9 from datanode e4d6ee2f-83c0-408a-99a7-b075597d4fb5 2023-02-12 12:03:41,955 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x889b43d816774e7d: from storage DS-de7a25bb-3635-47e6-863e-4b6d33f122e9 node DatanodeRegistration(127.0.0.1:38379, datanodeUuid=e4d6ee2f-83c0-408a-99a7-b075597d4fb5, infoPort=37263, infoSecurePort=0, ipcPort=32779, storageInfo=lv=-57;cid=testClusterID;nsid=1832001149;c=1676203421417), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:41,955 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x889b43d816774e7d: Processing first storage report for DS-09bc2fb8-164f-4aec-b819-6dd9781efa90 from datanode e4d6ee2f-83c0-408a-99a7-b075597d4fb5 2023-02-12 12:03:41,955 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x889b43d816774e7d: from storage DS-09bc2fb8-164f-4aec-b819-6dd9781efa90 node DatanodeRegistration(127.0.0.1:38379, datanodeUuid=e4d6ee2f-83c0-408a-99a7-b075597d4fb5, infoPort=37263, infoSecurePort=0, ipcPort=32779, storageInfo=lv=-57;cid=testClusterID;nsid=1832001149;c=1676203421417), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:41,967 DEBUG [Listener at localhost/32779] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a 2023-02-12 12:03:41,968 INFO [Listener at localhost/32779] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/cluster_2611dbbe-8ccc-905a-d076-c9b47b6c49c9/zookeeper_0, clientPort=53342, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/cluster_2611dbbe-8ccc-905a-d076-c9b47b6c49c9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/cluster_2611dbbe-8ccc-905a-d076-c9b47b6c49c9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 12:03:41,969 INFO [Listener at localhost/32779] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53342 2023-02-12 12:03:41,970 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:41,970 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:41,984 INFO [Listener at localhost/32779] util.FSUtils(479): Created version file at hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4 with version=8 2023-02-12 12:03:41,984 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:41,985 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:41,986 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45319/user/jenkins/test-data/c8436873-2153-4813-f849-1e4594a3401b/hbase-staging 2023-02-12 12:03:41,988 INFO [Listener at localhost/32779] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:41,988 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:41,988 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:41,988 INFO [Listener at localhost/32779] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:41,988 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:41,988 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:41,988 INFO [Listener at localhost/32779] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:41,989 INFO [Listener at localhost/32779] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45697 2023-02-12 12:03:41,990 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:41,990 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:41,991 INFO [Listener at localhost/32779] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45697 connecting to ZooKeeper ensemble=127.0.0.1:53342 2023-02-12 12:03:41,997 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:456970x0, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:41,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45697-0x100486a5ad50000 connected 2023-02-12 12:03:42,016 DEBUG [Listener at localhost/32779] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:42,016 DEBUG [Listener at localhost/32779] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:42,017 DEBUG [Listener at localhost/32779] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:42,017 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45697 2023-02-12 12:03:42,017 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45697 2023-02-12 12:03:42,018 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45697 2023-02-12 12:03:42,023 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45697 2023-02-12 12:03:42,024 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45697 2023-02-12 12:03:42,024 INFO [Listener at localhost/32779] master.HMaster(439): hbase.rootdir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4, hbase.cluster.distributed=false 2023-02-12 12:03:42,035 INFO [Listener at localhost/32779] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:42,035 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:42,035 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:42,036 INFO [Listener at localhost/32779] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:42,036 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:42,036 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:42,036 INFO [Listener at localhost/32779] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:42,040 INFO [Listener at localhost/32779] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37741 2023-02-12 12:03:42,040 INFO [Listener at localhost/32779] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:42,041 DEBUG [Listener at localhost/32779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:42,041 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:42,042 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:42,043 INFO [Listener at localhost/32779] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37741 connecting to ZooKeeper ensemble=127.0.0.1:53342 2023-02-12 12:03:42,045 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:377410x0, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:42,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37741-0x100486a5ad50001 connected 2023-02-12 12:03:42,046 DEBUG [Listener at localhost/32779] zookeeper.ZKUtil(164): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:42,046 DEBUG [Listener at localhost/32779] zookeeper.ZKUtil(164): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:42,047 DEBUG [Listener at localhost/32779] zookeeper.ZKUtil(164): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:42,047 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37741 2023-02-12 12:03:42,047 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37741 2023-02-12 12:03:42,047 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37741 2023-02-12 12:03:42,048 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37741 2023-02-12 12:03:42,051 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37741 2023-02-12 12:03:42,062 INFO [Listener at localhost/32779] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:42,062 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:42,062 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:42,062 INFO [Listener at localhost/32779] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:42,062 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:42,062 INFO [Listener at localhost/32779] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:42,062 INFO [Listener at localhost/32779] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:42,063 INFO [Listener at localhost/32779] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41705 2023-02-12 12:03:42,063 INFO [Listener at localhost/32779] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:42,064 DEBUG [Listener at localhost/32779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:42,064 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:42,065 INFO [Listener at localhost/32779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:42,066 INFO [Listener at localhost/32779] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41705 connecting to ZooKeeper ensemble=127.0.0.1:53342 2023-02-12 12:03:42,068 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:417050x0, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:42,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41705-0x100486a5ad50002 connected 2023-02-12 12:03:42,069 DEBUG [Listener at localhost/32779] zookeeper.ZKUtil(164): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:42,069 DEBUG [Listener at localhost/32779] zookeeper.ZKUtil(164): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:42,070 DEBUG [Listener at localhost/32779] zookeeper.ZKUtil(164): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:42,071 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41705 2023-02-12 12:03:42,072 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41705 2023-02-12 12:03:42,076 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41705 2023-02-12 12:03:42,121 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41705 2023-02-12 12:03:42,121 DEBUG [Listener at localhost/32779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41705 2023-02-12 12:03:42,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:42,128 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:42,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:42,129 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:42,129 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:42,129 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:42,131 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:42,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:42,132 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45697,1676203421987 from backup master directory 2023-02-12 12:03:42,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:42,134 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:42,134 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:42,134 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:42,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:42,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/hbase.id with ID: fadd7140-0e6b-47c6-8169-267af619aff7 2023-02-12 12:03:42,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:42,155 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:42,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1d7311f6 to 127.0.0.1:53342 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:42,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14c4eb77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:42,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:42,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 12:03:42,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:42,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/data/master/store-tmp 2023-02-12 12:03:42,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:42,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:42,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:42,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:42,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:42,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:42,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:42,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203422179Disabling compacts and flushes for region at 1676203422179Disabling writes for close at 1676203422179Writing region close event to WAL at 1676203422179Closed at 1676203422179 2023-02-12 12:03:42,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/WALs/jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:42,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45697%2C1676203421987, suffix=, logDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/WALs/jenkins-hbase4.apache.org,45697,1676203421987, archiveDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/oldWALs, maxLogs=10 2023-02-12 12:03:42,199 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45465,DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d,DISK] 2023-02-12 12:03:42,199 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38379,DS-de7a25bb-3635-47e6-863e-4b6d33f122e9,DISK] 2023-02-12 12:03:42,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/WALs/jenkins-hbase4.apache.org,45697,1676203421987/jenkins-hbase4.apache.org%2C45697%2C1676203421987.1676203422182 2023-02-12 12:03:42,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45465,DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d,DISK], DatanodeInfoWithStorage[127.0.0.1:38379,DS-de7a25bb-3635-47e6-863e-4b6d33f122e9,DISK]] 2023-02-12 12:03:42,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:42,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:42,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:42,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:42,202 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:42,204 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 12:03:42,204 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 12:03:42,204 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:42,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:42,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:42,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:42,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:42,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63462443, jitterRate=-0.054335907101631165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:42,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676203422202Initializing all the Stores at 1676203422202Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203422202Cleaning up temporary data from old regions at 1676203422205 (+3 ms)Cleaning up detritus from prior splits at 1676203422205Region opened successfully at 1676203422208 (+3 ms) 2023-02-12 12:03:42,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 12:03:42,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 12:03:42,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 12:03:42,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 12:03:42,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 12:03:42,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 12:03:42,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 12:03:42,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 12:03:42,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 12:03:42,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 12:03:42,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 12:03:42,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 12:03:42,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 12:03:42,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 12:03:42,224 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:42,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 12:03:42,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 12:03:42,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 12:03:42,226 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:42,226 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:42,226 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:42,226 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:42,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,45697,1676203421987, sessionid=0x100486a5ad50000, setting cluster-up flag (Was=false) 2023-02-12 12:03:42,233 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:42,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 12:03:42,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:42,240 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:42,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 12:03:42,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:42,246 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.hbase-snapshot/.tmp 2023-02-12 12:03:42,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:42,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:42,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:42,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:42,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:42,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 12:03:42,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:42,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676203452249 2023-02-12 12:03:42,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 12:03:42,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 12:03:42,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 12:03:42,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 12:03:42,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 12:03:42,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 12:03:42,250 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:42,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,250 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 12:03:42,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 12:03:42,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 12:03:42,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 12:03:42,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 12:03:42,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 12:03:42,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203422251,5,FailOnTimeoutGroup] 2023-02-12 12:03:42,251 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:42,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203422251,5,FailOnTimeoutGroup] 2023-02-12 12:03:42,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 12:03:42,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,264 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:42,264 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:42,265 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4 2023-02-12 12:03:42,272 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:42,276 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:42,277 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/info 2023-02-12 12:03:42,277 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:42,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:42,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:42,278 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:42,278 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:42,279 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:42,279 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:42,280 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/table 2023-02-12 12:03:42,280 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:42,280 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:42,281 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740 2023-02-12 12:03:42,281 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740 2023-02-12 12:03:42,282 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:42,283 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:42,285 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:42,285 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59030290, jitterRate=-0.12038013339042664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:42,285 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676203422272Initializing all the Stores at 1676203422273 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203422273Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203422276 (+3 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203422276Cleaning up temporary data from old regions at 1676203422282 (+6 ms)Cleaning up detritus from prior splits at 1676203422282Region opened successfully at 1676203422285 (+3 ms) 2023-02-12 12:03:42,285 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:42,285 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:42,285 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:42,285 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:42,285 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:42,285 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:42,285 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203422285Disabling compacts and flushes for region at 1676203422285Disabling writes for close at 1676203422285Writing region close event to WAL at 1676203422285Closed at 1676203422285 2023-02-12 12:03:42,286 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:42,286 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 12:03:42,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 12:03:42,288 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 12:03:42,289 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 12:03:42,324 INFO [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(952): ClusterId : fadd7140-0e6b-47c6-8169-267af619aff7 2023-02-12 12:03:42,324 INFO [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(952): ClusterId : fadd7140-0e6b-47c6-8169-267af619aff7 2023-02-12 12:03:42,325 DEBUG [RS:0;jenkins-hbase4:37741] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:42,325 DEBUG [RS:1;jenkins-hbase4:41705] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:42,327 DEBUG [RS:0;jenkins-hbase4:37741] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:42,327 DEBUG [RS:0;jenkins-hbase4:37741] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:42,327 DEBUG [RS:1;jenkins-hbase4:41705] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:42,327 DEBUG [RS:1;jenkins-hbase4:41705] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:42,329 DEBUG [RS:0;jenkins-hbase4:37741] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:42,330 DEBUG [RS:0;jenkins-hbase4:37741] zookeeper.ReadOnlyZKClient(139): Connect 0x44a73cb6 to 127.0.0.1:53342 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:42,330 DEBUG [RS:1;jenkins-hbase4:41705] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:42,331 DEBUG [RS:1;jenkins-hbase4:41705] zookeeper.ReadOnlyZKClient(139): Connect 0x754e3a3a to 127.0.0.1:53342 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:42,334 DEBUG [RS:0;jenkins-hbase4:37741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a60ca52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:42,335 DEBUG [RS:1;jenkins-hbase4:41705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b89cae3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:42,335 DEBUG [RS:0;jenkins-hbase4:37741] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e5f57c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:42,335 DEBUG [RS:1;jenkins-hbase4:41705] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fb6514a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:42,343 DEBUG [RS:0;jenkins-hbase4:37741] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37741 2023-02-12 12:03:42,343 INFO [RS:0;jenkins-hbase4:37741] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:42,343 INFO [RS:0;jenkins-hbase4:37741] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:42,343 DEBUG [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:42,344 INFO [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45697,1676203421987 with isa=jenkins-hbase4.apache.org/172.31.14.131:37741, startcode=1676203422035 2023-02-12 12:03:42,344 DEBUG [RS:0;jenkins-hbase4:37741] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:42,346 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50341, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:42,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:42,348 DEBUG [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4 2023-02-12 12:03:42,348 DEBUG [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45319 2023-02-12 12:03:42,348 DEBUG [RS:1;jenkins-hbase4:41705] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41705 2023-02-12 12:03:42,348 DEBUG [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:42,348 INFO [RS:1;jenkins-hbase4:41705] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:42,348 INFO [RS:1;jenkins-hbase4:41705] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:42,348 DEBUG [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:42,348 INFO [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45697,1676203421987 with isa=jenkins-hbase4.apache.org/172.31.14.131:41705, startcode=1676203422061 2023-02-12 12:03:42,348 DEBUG [RS:1;jenkins-hbase4:41705] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:42,349 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:42,349 DEBUG [RS:0;jenkins-hbase4:37741] zookeeper.ZKUtil(162): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:42,350 WARN [RS:0;jenkins-hbase4:37741] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:42,350 INFO [RS:0;jenkins-hbase4:37741] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:42,350 DEBUG [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/WALs/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:42,350 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37741,1676203422035] 2023-02-12 12:03:42,350 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47407, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:42,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:42,352 DEBUG [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4 2023-02-12 12:03:42,352 DEBUG [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45319 2023-02-12 12:03:42,352 DEBUG [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:42,356 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:42,357 DEBUG [RS:1;jenkins-hbase4:41705] zookeeper.ZKUtil(162): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:42,357 WARN [RS:1;jenkins-hbase4:41705] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:42,357 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41705,1676203422061] 2023-02-12 12:03:42,357 INFO [RS:1;jenkins-hbase4:41705] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:42,357 DEBUG [RS:0;jenkins-hbase4:37741] zookeeper.ZKUtil(162): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:42,357 DEBUG [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/WALs/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:42,357 DEBUG [RS:0;jenkins-hbase4:37741] zookeeper.ZKUtil(162): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:42,359 DEBUG [RS:0;jenkins-hbase4:37741] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:42,359 INFO [RS:0;jenkins-hbase4:37741] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:42,360 DEBUG [RS:1;jenkins-hbase4:41705] zookeeper.ZKUtil(162): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:42,360 DEBUG [RS:1;jenkins-hbase4:41705] zookeeper.ZKUtil(162): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:42,361 INFO [RS:0;jenkins-hbase4:37741] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:42,361 DEBUG [RS:1;jenkins-hbase4:41705] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:42,361 INFO [RS:0;jenkins-hbase4:37741] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:42,361 INFO [RS:1;jenkins-hbase4:41705] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:42,361 INFO [RS:0;jenkins-hbase4:37741] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,361 INFO [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:42,363 INFO [RS:0;jenkins-hbase4:37741] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,363 DEBUG [RS:0;jenkins-hbase4:37741] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,365 INFO [RS:1;jenkins-hbase4:41705] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:42,369 INFO [RS:1;jenkins-hbase4:41705] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:42,369 INFO [RS:1;jenkins-hbase4:41705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,369 INFO [RS:0;jenkins-hbase4:37741] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,369 INFO [RS:0;jenkins-hbase4:37741] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,370 INFO [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:42,370 INFO [RS:0;jenkins-hbase4:37741] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,371 INFO [RS:1;jenkins-hbase4:41705] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,371 DEBUG [RS:1;jenkins-hbase4:41705] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:42,376 INFO [RS:1;jenkins-hbase4:41705] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,376 INFO [RS:1;jenkins-hbase4:41705] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,376 INFO [RS:1;jenkins-hbase4:41705] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,385 INFO [RS:0;jenkins-hbase4:37741] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:42,385 INFO [RS:0;jenkins-hbase4:37741] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37741,1676203422035-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,386 INFO [RS:1;jenkins-hbase4:41705] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:42,386 INFO [RS:1;jenkins-hbase4:41705] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41705,1676203422061-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,395 INFO [RS:0;jenkins-hbase4:37741] regionserver.Replication(203): jenkins-hbase4.apache.org,37741,1676203422035 started 2023-02-12 12:03:42,395 INFO [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37741,1676203422035, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37741, sessionid=0x100486a5ad50001 2023-02-12 12:03:42,395 DEBUG [RS:0;jenkins-hbase4:37741] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:42,395 DEBUG [RS:0;jenkins-hbase4:37741] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:42,395 DEBUG [RS:0;jenkins-hbase4:37741] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37741,1676203422035' 2023-02-12 12:03:42,395 DEBUG [RS:0;jenkins-hbase4:37741] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:42,396 INFO [RS:1;jenkins-hbase4:41705] regionserver.Replication(203): jenkins-hbase4.apache.org,41705,1676203422061 started 2023-02-12 12:03:42,396 DEBUG [RS:0;jenkins-hbase4:37741] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:42,396 INFO [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41705,1676203422061, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41705, sessionid=0x100486a5ad50002 2023-02-12 12:03:42,396 DEBUG [RS:1;jenkins-hbase4:41705] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:42,396 DEBUG [RS:1;jenkins-hbase4:41705] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:42,396 DEBUG [RS:1;jenkins-hbase4:41705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41705,1676203422061' 2023-02-12 12:03:42,396 DEBUG [RS:1;jenkins-hbase4:41705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:42,396 DEBUG [RS:0;jenkins-hbase4:37741] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:42,396 DEBUG [RS:0;jenkins-hbase4:37741] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:42,396 DEBUG [RS:0;jenkins-hbase4:37741] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:42,396 DEBUG [RS:0;jenkins-hbase4:37741] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37741,1676203422035' 2023-02-12 12:03:42,396 DEBUG [RS:1;jenkins-hbase4:41705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:42,396 DEBUG [RS:0;jenkins-hbase4:37741] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:42,397 DEBUG [RS:1;jenkins-hbase4:41705] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:42,397 DEBUG [RS:1;jenkins-hbase4:41705] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:42,397 DEBUG [RS:1;jenkins-hbase4:41705] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:42,397 DEBUG [RS:1;jenkins-hbase4:41705] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41705,1676203422061' 2023-02-12 12:03:42,397 DEBUG [RS:0;jenkins-hbase4:37741] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:42,397 DEBUG [RS:1;jenkins-hbase4:41705] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:42,397 DEBUG [RS:0;jenkins-hbase4:37741] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:42,397 DEBUG [RS:1;jenkins-hbase4:41705] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:42,397 INFO [RS:0;jenkins-hbase4:37741] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:42,397 INFO [RS:0;jenkins-hbase4:37741] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:42,397 DEBUG [RS:1;jenkins-hbase4:41705] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:42,397 INFO [RS:1;jenkins-hbase4:41705] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:42,397 INFO [RS:1;jenkins-hbase4:41705] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:42,439 DEBUG [jenkins-hbase4:45697] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 12:03:42,439 DEBUG [jenkins-hbase4:45697] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:42,440 DEBUG [jenkins-hbase4:45697] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:42,440 DEBUG [jenkins-hbase4:45697] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:42,440 DEBUG [jenkins-hbase4:45697] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:42,441 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37741,1676203422035, state=OPENING 2023-02-12 12:03:42,442 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 12:03:42,443 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:42,443 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:42,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37741,1676203422035}] 2023-02-12 12:03:42,598 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:42,598 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:42,600 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37694, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:42,605 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 12:03:42,605 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:42,607 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37741%2C1676203422035.meta, suffix=.meta, logDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/WALs/jenkins-hbase4.apache.org,37741,1676203422035, archiveDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/oldWALs, maxLogs=32 2023-02-12 12:03:42,622 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45465,DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d,DISK] 2023-02-12 12:03:42,622 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38379,DS-de7a25bb-3635-47e6-863e-4b6d33f122e9,DISK] 2023-02-12 12:03:42,624 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/WALs/jenkins-hbase4.apache.org,37741,1676203422035/jenkins-hbase4.apache.org%2C37741%2C1676203422035.meta.1676203422607.meta 2023-02-12 12:03:42,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45465,DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d,DISK], DatanodeInfoWithStorage[127.0.0.1:38379,DS-de7a25bb-3635-47e6-863e-4b6d33f122e9,DISK]] 2023-02-12 12:03:42,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:42,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 12:03:42,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 12:03:42,624 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 12:03:42,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 12:03:42,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:42,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 12:03:42,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 12:03:42,625 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:42,626 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/info 2023-02-12 12:03:42,626 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/info 2023-02-12 12:03:42,627 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:42,627 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:42,627 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:42,628 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:42,628 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:42,628 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:42,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:42,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:42,629 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/table 2023-02-12 12:03:42,629 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/table 2023-02-12 12:03:42,630 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:42,630 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:42,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740 2023-02-12 12:03:42,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740 2023-02-12 12:03:42,633 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:42,634 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:42,635 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73879457, jitterRate=0.10088969767093658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:42,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676203422625Writing region info on filesystem at 1676203422625Initializing all the Stores at 1676203422625Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203422625Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203422625Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203422625Cleaning up temporary data from old regions at 1676203422632 (+7 ms)Cleaning up detritus from prior splits at 1676203422632Running coprocessor post-open hooks at 1676203422635 (+3 ms)Region opened successfully at 1676203422635 2023-02-12 12:03:42,636 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676203422598 2023-02-12 12:03:42,639 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 12:03:42,639 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 12:03:42,640 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37741,1676203422035, state=OPEN 2023-02-12 12:03:42,641 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 12:03:42,641 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:42,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 12:03:42,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37741,1676203422035 in 198 msec 2023-02-12 12:03:42,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 12:03:42,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-12 12:03:42,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-12 12:03:42,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676203422128, completionTime=-1 2023-02-12 12:03:42,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 12:03:42,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 12:03:42,647 DEBUG [hconnection-0x64fc917f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:42,648 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37696, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:42,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 12:03:42,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676203482650 2023-02-12 12:03:42,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676203542650 2023-02-12 12:03:42,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-12 12:03:42,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45697,1676203421987-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45697,1676203421987-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45697,1676203421987-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45697, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:42,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 12:03:42,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:42,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 12:03:42,660 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 12:03:42,661 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:42,661 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:42,663 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:42,663 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590 empty. 2023-02-12 12:03:42,663 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:42,663 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 12:03:42,672 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:42,673 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e873bf0788f6c5d36da3b7d232795590, NAME => 'hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp 2023-02-12 12:03:42,681 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:42,681 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e873bf0788f6c5d36da3b7d232795590, disabling compactions & flushes 2023-02-12 12:03:42,681 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:42,681 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:42,681 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. after waiting 0 ms 2023-02-12 12:03:42,681 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:42,682 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:42,682 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e873bf0788f6c5d36da3b7d232795590: Waiting for close lock at 1676203422681Disabling compacts and flushes for region at 1676203422681Disabling writes for close at 1676203422681Writing region close event to WAL at 1676203422682 (+1 ms)Closed at 1676203422682 2023-02-12 12:03:42,683 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:42,684 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203422684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203422684"}]},"ts":"1676203422684"} 2023-02-12 12:03:42,685 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:42,685 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:42,686 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203422686"}]},"ts":"1676203422686"} 2023-02-12 12:03:42,687 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 12:03:42,689 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:42,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:42,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:42,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:42,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e873bf0788f6c5d36da3b7d232795590, ASSIGN}] 2023-02-12 12:03:42,692 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e873bf0788f6c5d36da3b7d232795590, ASSIGN 2023-02-12 12:03:42,693 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e873bf0788f6c5d36da3b7d232795590, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41705,1676203422061; forceNewPlan=false, retain=false 2023-02-12 12:03:42,843 INFO [jenkins-hbase4:45697] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:42,844 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e873bf0788f6c5d36da3b7d232795590, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:42,844 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203422844"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203422844"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203422844"}]},"ts":"1676203422844"} 2023-02-12 12:03:42,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e873bf0788f6c5d36da3b7d232795590, server=jenkins-hbase4.apache.org,41705,1676203422061}] 2023-02-12 12:03:42,998 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:42,998 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:43,000 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41598, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:43,003 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:43,004 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41705%2C1676203422061, suffix=, logDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/WALs/jenkins-hbase4.apache.org,41705,1676203422061, archiveDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/oldWALs, maxLogs=32 2023-02-12 12:03:43,018 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38379,DS-de7a25bb-3635-47e6-863e-4b6d33f122e9,DISK] 2023-02-12 12:03:43,018 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45465,DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d,DISK] 2023-02-12 12:03:43,020 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/WALs/jenkins-hbase4.apache.org,41705,1676203422061/jenkins-hbase4.apache.org%2C41705%2C1676203422061.1676203423005 2023-02-12 12:03:43,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38379,DS-de7a25bb-3635-47e6-863e-4b6d33f122e9,DISK], DatanodeInfoWithStorage[127.0.0.1:45465,DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d,DISK]] 2023-02-12 12:03:43,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e873bf0788f6c5d36da3b7d232795590, NAME => 'hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:43,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:43,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:43,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:43,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:43,021 INFO [StoreOpener-e873bf0788f6c5d36da3b7d232795590-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:43,022 DEBUG [StoreOpener-e873bf0788f6c5d36da3b7d232795590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590/info 2023-02-12 12:03:43,022 DEBUG [StoreOpener-e873bf0788f6c5d36da3b7d232795590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590/info 2023-02-12 12:03:43,023 INFO [StoreOpener-e873bf0788f6c5d36da3b7d232795590-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e873bf0788f6c5d36da3b7d232795590 columnFamilyName info 2023-02-12 12:03:43,023 INFO [StoreOpener-e873bf0788f6c5d36da3b7d232795590-1] regionserver.HStore(310): Store=e873bf0788f6c5d36da3b7d232795590/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:43,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:43,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:43,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:43,030 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:43,031 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e873bf0788f6c5d36da3b7d232795590; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62611484, jitterRate=-0.06701618432998657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:43,031 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e873bf0788f6c5d36da3b7d232795590: Running coprocessor pre-open hook at 1676203423020Writing region info on filesystem at 1676203423020Initializing all the Stores at 1676203423021 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203423021Cleaning up temporary data from old regions at 1676203423024 (+3 ms)Cleaning up detritus from prior splits at 1676203423028 (+4 ms)Running coprocessor post-open hooks at 1676203423031 (+3 ms)Region opened successfully at 1676203423031 2023-02-12 12:03:43,031 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590., pid=6, masterSystemTime=1676203422998 2023-02-12 12:03:43,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:43,035 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:43,035 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e873bf0788f6c5d36da3b7d232795590, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:43,035 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203423035"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203423035"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203423035"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203423035"}]},"ts":"1676203423035"} 2023-02-12 12:03:43,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 12:03:43,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e873bf0788f6c5d36da3b7d232795590, server=jenkins-hbase4.apache.org,41705,1676203422061 in 191 msec 2023-02-12 12:03:43,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 12:03:43,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e873bf0788f6c5d36da3b7d232795590, ASSIGN in 348 msec 2023-02-12 12:03:43,039 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:43,040 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203423040"}]},"ts":"1676203423040"} 2023-02-12 12:03:43,041 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 12:03:43,043 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:43,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 385 msec 2023-02-12 12:03:43,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 12:03:43,062 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:43,062 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:43,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:43,065 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41612, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:43,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 12:03:43,073 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:43,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 12:03:43,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 12:03:43,085 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:43,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-12 12:03:43,091 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 12:03:43,094 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 12:03:43,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.960sec 2023-02-12 12:03:43,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 12:03:43,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 12:03:43,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 12:03:43,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45697,1676203421987-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 12:03:43,095 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45697,1676203421987-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 12:03:43,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 12:03:43,125 DEBUG [Listener at localhost/32779] zookeeper.ReadOnlyZKClient(139): Connect 0x0062a108 to 127.0.0.1:53342 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:43,128 DEBUG [Listener at localhost/32779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ba8713c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:43,129 DEBUG [hconnection-0x21c3422c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:43,131 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37700, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:43,132 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:43,132 DEBUG [Listener at localhost/32779] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 12:03:43,134 DEBUG [Listener at localhost/32779] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 12:03:43,136 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51306, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 12:03:43,137 INFO [Listener at localhost/32779] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:43,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:43,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 12:03:43,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:51306 deadline: 1676203483137, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:43,138 INFO [Listener at localhost/32779] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 12:03:43,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:43,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:43,142 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:43,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-12 12:03:43,142 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:43,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:43,144 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,144 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0 empty. 2023-02-12 12:03:43,144 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,145 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 12:03:43,154 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:43,155 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 054edaa2dc258faa6d3cb24433347ad0, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp 2023-02-12 12:03:43,161 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:43,162 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 054edaa2dc258faa6d3cb24433347ad0, disabling compactions & flushes 2023-02-12 12:03:43,162 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,162 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,162 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. after waiting 0 ms 2023-02-12 12:03:43,162 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,162 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,162 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 054edaa2dc258faa6d3cb24433347ad0: Waiting for close lock at 1676203423162Disabling compacts and flushes for region at 1676203423162Disabling writes for close at 1676203423162Writing region close event to WAL at 1676203423162Closed at 1676203423162 2023-02-12 12:03:43,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:43,165 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676203423165"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203423165"}]},"ts":"1676203423165"} 2023-02-12 12:03:43,166 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:43,167 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:43,167 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203423167"}]},"ts":"1676203423167"} 2023-02-12 12:03:43,168 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-12 12:03:43,171 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:43,172 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:43,172 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:43,172 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:43,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=054edaa2dc258faa6d3cb24433347ad0, ASSIGN}] 2023-02-12 12:03:43,174 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=054edaa2dc258faa6d3cb24433347ad0, ASSIGN 2023-02-12 12:03:43,175 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=054edaa2dc258faa6d3cb24433347ad0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37741,1676203422035; forceNewPlan=false, retain=false 2023-02-12 12:03:43,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:43,325 INFO [jenkins-hbase4:45697] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:43,325 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=054edaa2dc258faa6d3cb24433347ad0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,325 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676203423325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203423325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203423325"}]},"ts":"1676203423325"} 2023-02-12 12:03:43,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 054edaa2dc258faa6d3cb24433347ad0, server=jenkins-hbase4.apache.org,37741,1676203422035}] 2023-02-12 12:03:43,399 INFO [RS:0;jenkins-hbase4:37741] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37741%2C1676203422035, suffix=, logDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/WALs/jenkins-hbase4.apache.org,37741,1676203422035, archiveDir=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/oldWALs, maxLogs=32 2023-02-12 12:03:43,411 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38379,DS-de7a25bb-3635-47e6-863e-4b6d33f122e9,DISK] 2023-02-12 12:03:43,411 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45465,DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d,DISK] 2023-02-12 12:03:43,412 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 12:03:43,415 INFO [RS:0;jenkins-hbase4:37741] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/WALs/jenkins-hbase4.apache.org,37741,1676203422035/jenkins-hbase4.apache.org%2C37741%2C1676203422035.1676203423399 2023-02-12 12:03:43,416 DEBUG [RS:0;jenkins-hbase4:37741] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45465,DS-8c33b221-66fe-4441-953f-14ab9ae0fc1d,DISK], DatanodeInfoWithStorage[127.0.0.1:38379,DS-de7a25bb-3635-47e6-863e-4b6d33f122e9,DISK]] 2023-02-12 12:03:43,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:43,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 054edaa2dc258faa6d3cb24433347ad0, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:43,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:43,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,486 INFO [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,487 DEBUG [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1 2023-02-12 12:03:43,487 DEBUG [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1 2023-02-12 12:03:43,487 INFO [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 054edaa2dc258faa6d3cb24433347ad0 columnFamilyName f1 2023-02-12 12:03:43,487 INFO [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] regionserver.HStore(310): Store=054edaa2dc258faa6d3cb24433347ad0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:43,488 INFO [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,489 DEBUG [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2 2023-02-12 12:03:43,489 DEBUG [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2 2023-02-12 12:03:43,489 INFO [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 054edaa2dc258faa6d3cb24433347ad0 columnFamilyName f2 2023-02-12 12:03:43,489 INFO [StoreOpener-054edaa2dc258faa6d3cb24433347ad0-1] regionserver.HStore(310): Store=054edaa2dc258faa6d3cb24433347ad0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:43,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:43,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:43,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:43,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 054edaa2dc258faa6d3cb24433347ad0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60819710, jitterRate=-0.09371569752693176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:43,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 054edaa2dc258faa6d3cb24433347ad0: Running coprocessor pre-open hook at 1676203423483Writing region info on filesystem at 1676203423483Initializing all the Stores at 1676203423485 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203423485Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203423485Cleaning up temporary data from old regions at 1676203423492 (+7 ms)Cleaning up detritus from prior splits at 1676203423492Running coprocessor post-open hooks at 1676203423496 (+4 ms)Region opened successfully at 1676203423496 2023-02-12 12:03:43,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0., pid=12, masterSystemTime=1676203423480 2023-02-12 12:03:43,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,499 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=054edaa2dc258faa6d3cb24433347ad0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,499 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676203423499"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203423499"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203423499"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203423499"}]},"ts":"1676203423499"} 2023-02-12 12:03:43,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 12:03:43,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 054edaa2dc258faa6d3cb24433347ad0, server=jenkins-hbase4.apache.org,37741,1676203422035 in 173 msec 2023-02-12 12:03:43,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 12:03:43,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=054edaa2dc258faa6d3cb24433347ad0, ASSIGN in 330 msec 2023-02-12 12:03:43,504 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:43,504 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203423504"}]},"ts":"1676203423504"} 2023-02-12 12:03:43,505 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-12 12:03:43,508 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:43,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 368 msec 2023-02-12 12:03:43,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:43,747 INFO [Listener at localhost/32779] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-12 12:03:43,747 DEBUG [Listener at localhost/32779] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-12 12:03:43,747 INFO [Listener at localhost/32779] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:43,749 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-12 12:03:43,749 INFO [Listener at localhost/32779] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:43,749 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-12 12:03:43,749 INFO [Listener at localhost/32779] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 12:03:43,783 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37741] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,868 INFO [Listener at localhost/32779] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 12:03:43,868 INFO [Listener at localhost/32779] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 12:03:43,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 12:03:43,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676203423869 (current time:1676203423869). 2023-02-12 12:03:43,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 12:03:43,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] zookeeper.ReadOnlyZKClient(139): Connect 0x0223180e to 127.0.0.1:53342 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:43,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@303afdee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:43,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:43,875 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51732, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:43,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0223180e to 127.0.0.1:53342 2023-02-12 12:03:43,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:43,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 12:03:43,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 12:03:43,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 12:03:43,879 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 12:03:43,879 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676204023879 2023-02-12 12:03:43,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 12:03:43,880 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:43,881 DEBUG [Listener at localhost/32779] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:43,881 DEBUG [Listener at localhost/32779] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 12:03:43,882 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 12:03:43,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 12:03:43,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-12 12:03:43,883 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 12:03:43,884 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676204023884 2023-02-12 12:03:43,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 12:03:43,890 INFO [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 12:03:43,890 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:43,891 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 12:03:43,891 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 12:03:43,892 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 12:03:43,892 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:43,894 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:43,894 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:43,894 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:43,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:43,894 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,894 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 12:03:43,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 12:03:43,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 12:03:43,896 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 12:03:43,896 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:43,896 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 12:03:43,896 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 12:03:43,896 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41705,1676203422061' joining acquired barrier for procedure (foo) in zk 2023-02-12 12:03:43,896 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 12:03:43,897 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:43,897 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 12:03:43,897 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 12:03:43,897 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37741,1676203422035' joining acquired barrier for procedure (foo) in zk 2023-02-12 12:03:43,898 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,899 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,899 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,899 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,899 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:43,899 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,899 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:43,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:43,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37741,1676203422035' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 12:03:43,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62d7a703[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:43,901 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 12:03:43,901 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,902 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,902 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 12:03:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 12:03:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41705,1676203422061' in zk 2023-02-12 12:03:43,902 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,902 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:43,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 12:03:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 12:03:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 12:03:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:43,903 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,903 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. started... 2023-02-12 12:03:43,903 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 054edaa2dc258faa6d3cb24433347ad0 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 12:03:43,904 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 12:03:43,904 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:43,905 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 12:03:43,917 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/.tmp/f1/ae24a62bf9714b85ad508095b2ac1aa6 2023-02-12 12:03:43,941 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/.tmp/f2/1d717566665c41b9b5e5959cac70132e 2023-02-12 12:03:43,944 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/.tmp/f1/ae24a62bf9714b85ad508095b2ac1aa6 as hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/ae24a62bf9714b85ad508095b2ac1aa6 2023-02-12 12:03:43,948 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/ae24a62bf9714b85ad508095b2ac1aa6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 12:03:43,949 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/.tmp/f2/1d717566665c41b9b5e5959cac70132e as hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/1d717566665c41b9b5e5959cac70132e 2023-02-12 12:03:43,952 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/1d717566665c41b9b5e5959cac70132e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 12:03:43,953 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 054edaa2dc258faa6d3cb24433347ad0 in 50ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:43,953 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 12:03:43,953 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 054edaa2dc258faa6d3cb24433347ad0: 2023-02-12 12:03:43,954 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.' region-info for snapshot=foo 2023-02-12 12:03:43,954 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:43,954 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/ae24a62bf9714b85ad508095b2ac1aa6] hfiles 2023-02-12 12:03:43,954 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/ae24a62bf9714b85ad508095b2ac1aa6 for snapshot=foo 2023-02-12 12:03:43,954 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/1d717566665c41b9b5e5959cac70132e] hfiles 2023-02-12 12:03:43,954 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/1d717566665c41b9b5e5959cac70132e for snapshot=foo 2023-02-12 12:03:43,982 DEBUG [Listener at localhost/32779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:43,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 12:03:43,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:43,983 DEBUG [Listener at localhost/32779] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 12:03:43,993 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. completed. 2023-02-12 12:03:43,993 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:43,993 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 12:03:43,993 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 12:03:43,993 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,993 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 12:03:43,993 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,37741,1676203422035' in zk 2023-02-12 12:03:43,994 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,994 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 12:03:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 12:03:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,37741,1676203422035': 2023-02-12 12:03:43,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37741,1676203422035' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 12:03:43,998 INFO [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 12:03:43,998 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:43,998 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:43,998 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 12:03:43,998 INFO [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 12:03:43,999 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 12:03:43,999 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 12:03:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 12:03:43,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 12:03:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 12:03:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:43,999 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:43,999 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 12:03:44,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:44,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 12:03:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 12:03:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:44,000 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:44,000 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 12:03:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:44,000 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 12:03:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,002 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:44,002 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 12:03:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,008 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:44,008 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:44,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:44,008 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,008 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:44,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 12:03:44,008 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:44,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 12:03:44,008 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:44,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:44,008 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:44,008 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,009 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 12:03:44,009 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,009 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 12:03:44,009 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:44,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.hbase-snapshot/.tmp/foo 2023-02-12 12:03:44,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:44,009 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 12:03:44,009 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 12:03:44,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.hbase-snapshot/.tmp/foo to hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.hbase-snapshot/foo 2023-02-12 12:03:44,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-12 12:03:44,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.hbase-snapshot/.tmp/foo 2023-02-12 12:03:44,051 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.hbase-snapshot/.tmp/foo 2023-02-12 12:03:44,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676203423880Consolidate snapshot: foo at 1676203424008 (+128 ms)Loading Region manifests for foo at 1676203424009 (+1 ms)Writing data manifest for foo at 1676203424011 (+2 ms)Verifying snapshot: foo at 1676203424023 (+12 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676203424050 (+27 ms) 2023-02-12 12:03:44,053 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 12:03:44,054 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 172 msec 2023-02-12 12:03:44,184 DEBUG [Listener at localhost/32779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:44,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 12:03:44,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 12:03:44,185 INFO [Listener at localhost/32779] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 12:03:44,189 INFO [Listener at localhost/32779] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 12:03:44,193 INFO [Listener at localhost/32779] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 12:03:44,224 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37741] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,306 INFO [Listener at localhost/32779] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 12:03:44,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 12:03:44,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,313 INFO [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 12:03:44,313 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:44,314 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-12 12:03:44,314 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-12 12:03:44,315 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,315 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,316 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:44,316 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:44,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:44,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:44,316 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,316 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,317 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:44,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,323 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 12:03:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:44,324 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 12:03:44,324 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 12:03:44,324 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 12:03:44,324 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:44,324 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41705,1676203422061' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 12:03:44,325 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 12:03:44,325 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 12:03:44,325 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:44,325 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,325 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. started... 2023-02-12 12:03:44,325 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 054edaa2dc258faa6d3cb24433347ad0 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 12:03:44,326 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,326 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,327 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:44,347 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/.tmp/f1/a5c8242ebdd44376b8d9311cd4911a14 2023-02-12 12:03:44,366 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/.tmp/f2/0ae79890dffe4ff58f851e94bd1362d9 2023-02-12 12:03:44,370 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/.tmp/f1/a5c8242ebdd44376b8d9311cd4911a14 as hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/a5c8242ebdd44376b8d9311cd4911a14 2023-02-12 12:03:44,373 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/a5c8242ebdd44376b8d9311cd4911a14, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 12:03:44,374 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/.tmp/f2/0ae79890dffe4ff58f851e94bd1362d9 as hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/0ae79890dffe4ff58f851e94bd1362d9 2023-02-12 12:03:44,379 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/0ae79890dffe4ff58f851e94bd1362d9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 12:03:44,379 INFO [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 054edaa2dc258faa6d3cb24433347ad0 in 54ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:44,381 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 054edaa2dc258faa6d3cb24433347ad0: 2023-02-12 12:03:44,381 DEBUG [rs(jenkins-hbase4.apache.org,37741,1676203422035)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 12:03:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 12:03:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 12:03:44,381 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37741,1676203422035' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 12:03:44,382 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,383 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:44,383 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,383 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:44,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:44,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37741,1676203422035' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-12 12:03:44,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66e83f81[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:44,385 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-12 12:03:44,385 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,387 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,387 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,387 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 12:03:44,388 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,388 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:44,387 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 12:03:44,388 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 12:03:44,388 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 12:03:44,388 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,37741,1676203422035' in zk 2023-02-12 12:03:44,388 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,41705,1676203422061' in zk 2023-02-12 12:03:44,389 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 12:03:44,389 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 12:03:44,389 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,389 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:44,389 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:44,389 DEBUG [member: 'jenkins-hbase4.apache.org,41705,1676203422061' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 12:03:44,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:44,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:44,389 DEBUG [member: 'jenkins-hbase4.apache.org,37741,1676203422035' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 12:03:44,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:44,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:44,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,37741,1676203422035': 2023-02-12 12:03:44,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37741,1676203422035' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-12 12:03:44,392 INFO [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-12 12:03:44,392 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:44,392 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:44,392 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,393 INFO [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 12:03:44,394 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,394 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,394 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:44,394 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,394 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:44,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:44,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:44,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:44,395 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:44,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,395 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:44,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,396 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,397 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:44,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,399 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:44,399 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,399 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:44,399 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:44,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:44,399 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:44,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:44,399 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:44,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 12:03:44,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 12:03:44,400 DEBUG [(jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:44,399 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:44,400 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,400 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,400 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,400 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:44,400 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,400 DEBUG [Listener at localhost/32779] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:44,400 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,400 DEBUG [Listener at localhost/32779] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 12:03:44,501 DEBUG [Listener at localhost/32779] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 12:03:44,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 12:03:44,506 INFO [Listener at localhost/32779] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676203423869 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:44,506 DEBUG [Listener at localhost/32779] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45319/user/jenkins/test-data/c8436873-2153-4813-f849-1e4594a3401b/foo/f51fe06a-f375-4d2d-b17b-9862951a3498/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,506 INFO [Listener at localhost/32779] snapshot.RestoreSnapshotHelper(239): region to add: 054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:44,506 INFO [Listener at localhost/32779] snapshot.RestoreSnapshotHelper(585): clone region=054edaa2dc258faa6d3cb24433347ad0 as 054edaa2dc258faa6d3cb24433347ad0 in snapshot foo 2023-02-12 12:03:44,507 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 054edaa2dc258faa6d3cb24433347ad0, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45319/user/jenkins/test-data/c8436873-2153-4813-f849-1e4594a3401b/foo/f51fe06a-f375-4d2d-b17b-9862951a3498 2023-02-12 12:03:44,519 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:44,519 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ae24a62bf9714b85ad508095b2ac1aa6 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,521 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1d717566665c41b9b5e5959cac70132e from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,523 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 054edaa2dc258faa6d3cb24433347ad0, disabling compactions & flushes 2023-02-12 12:03:44,523 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,523 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,523 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. after waiting 0 ms 2023-02-12 12:03:44,523 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,523 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,523 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 054edaa2dc258faa6d3cb24433347ad0: Waiting for close lock at 1676203424523Disabling compacts and flushes for region at 1676203424523Disabling writes for close at 1676203424523Writing region close event to WAL at 1676203424523Closed at 1676203424523 2023-02-12 12:03:44,525 INFO [Listener at localhost/32779] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676203423869 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:44,525 DEBUG [Listener at localhost/32779] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45319/user/jenkins/test-data/c8436873-2153-4813-f849-1e4594a3401b/foo/f51fe06a-f375-4d2d-b17b-9862951a3498 2023-02-12 12:03:44,525 DEBUG [Listener at localhost/32779] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45319/user/jenkins/test-data/c8436873-2153-4813-f849-1e4594a3401b/foo/f51fe06a-f375-4d2d-b17b-9862951a3498 2023-02-12 12:03:44,525 DEBUG [Listener at localhost/32779] util.CommonFSUtils(699): |-data/ 2023-02-12 12:03:44,526 DEBUG [Listener at localhost/32779] util.CommonFSUtils(699): |----default/ 2023-02-12 12:03:44,526 DEBUG [Listener at localhost/32779] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-12 12:03:44,526 DEBUG [Listener at localhost/32779] util.CommonFSUtils(699): |----------054edaa2dc258faa6d3cb24433347ad0/ 2023-02-12 12:03:44,527 DEBUG [Listener at localhost/32779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:44,527 DEBUG [Listener at localhost/32779] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:44,527 DEBUG [Listener at localhost/32779] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=054edaa2dc258faa6d3cb24433347ad0-ae24a62bf9714b85ad508095b2ac1aa6 2023-02-12 12:03:44,527 DEBUG [Listener at localhost/32779] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:44,527 DEBUG [Listener at localhost/32779] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=054edaa2dc258faa6d3cb24433347ad0-1d717566665c41b9b5e5959cac70132e hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/a5c8242ebdd44376b8d9311cd4911a14 hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/ae24a62bf9714b85ad508095b2ac1aa6 hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/0ae79890dffe4ff58f851e94bd1362d9 hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/1d717566665c41b9b5e5959cac70132e 2023-02-12 12:03:44,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-12 12:03:44,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 12:03:44,536 INFO [Listener at localhost/32779] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:44,539 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203424539"}]},"ts":"1676203424539"} 2023-02-12 12:03:44,540 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-12 12:03:44,548 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-12 12:03:44,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=054edaa2dc258faa6d3cb24433347ad0, UNASSIGN}] 2023-02-12 12:03:44,550 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=054edaa2dc258faa6d3cb24433347ad0, UNASSIGN 2023-02-12 12:03:44,551 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=054edaa2dc258faa6d3cb24433347ad0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,551 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676203424550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203424550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203424550"}]},"ts":"1676203424550"} 2023-02-12 12:03:44,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 054edaa2dc258faa6d3cb24433347ad0, server=jenkins-hbase4.apache.org,37741,1676203422035}] 2023-02-12 12:03:44,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:44,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:44,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 054edaa2dc258faa6d3cb24433347ad0, disabling compactions & flushes 2023-02-12 12:03:44,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. after waiting 0 ms 2023-02-12 12:03:44,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:44,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0. 2023-02-12 12:03:44,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 054edaa2dc258faa6d3cb24433347ad0: Waiting for close lock at 1676203424704Running coprocessor pre-close hooks at 1676203424704Disabling compacts and flushes for region at 1676203424704Disabling writes for close at 1676203424704Writing region close event to WAL at 1676203424705 (+1 ms)Running coprocessor post-close hooks at 1676203424708 (+3 ms)Closed at 1676203424708 2023-02-12 12:03:44,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:44,709 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=054edaa2dc258faa6d3cb24433347ad0, regionState=CLOSED 2023-02-12 12:03:44,710 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676203424709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203424709"}]},"ts":"1676203424709"} 2023-02-12 12:03:44,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 12:03:44,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 054edaa2dc258faa6d3cb24433347ad0, server=jenkins-hbase4.apache.org,37741,1676203422035 in 159 msec 2023-02-12 12:03:44,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 12:03:44,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=054edaa2dc258faa6d3cb24433347ad0, UNASSIGN in 164 msec 2023-02-12 12:03:44,713 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203424713"}]},"ts":"1676203424713"} 2023-02-12 12:03:44,714 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-12 12:03:44,716 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-12 12:03:44,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 180 msec 2023-02-12 12:03:44,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:44,842 INFO [Listener at localhost/32779] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-12 12:03:44,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,845 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,845 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 12:03:44,848 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:44,850 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1, FileablePath, hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2, FileablePath, hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/recovered.edits] 2023-02-12 12:03:44,853 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/a5c8242ebdd44376b8d9311cd4911a14 to hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/a5c8242ebdd44376b8d9311cd4911a14 2023-02-12 12:03:44,854 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/ae24a62bf9714b85ad508095b2ac1aa6 to hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f1/ae24a62bf9714b85ad508095b2ac1aa6 2023-02-12 12:03:44,857 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/0ae79890dffe4ff58f851e94bd1362d9 to hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/0ae79890dffe4ff58f851e94bd1362d9 2023-02-12 12:03:44,858 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/1d717566665c41b9b5e5959cac70132e to hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/f2/1d717566665c41b9b5e5959cac70132e 2023-02-12 12:03:44,860 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/recovered.edits/12.seqid to hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0/recovered.edits/12.seqid 2023-02-12 12:03:44,860 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/054edaa2dc258faa6d3cb24433347ad0 2023-02-12 12:03:44,860 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 12:03:44,862 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,864 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-12 12:03:44,865 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-12 12:03:44,868 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,869 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-12 12:03:44,869 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203424869"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:44,870 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 12:03:44,870 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 054edaa2dc258faa6d3cb24433347ad0, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676203423140.054edaa2dc258faa6d3cb24433347ad0.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 12:03:44,870 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-12 12:03:44,870 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676203424870"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:44,871 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-12 12:03:44,873 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 12:03:44,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 30 msec 2023-02-12 12:03:44,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45697] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 12:03:44,947 INFO [Listener at localhost/32779] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-12 12:03:44,947 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 12:03:44,947 INFO [Listener at localhost/32779] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 12:03:44,948 DEBUG [Listener at localhost/32779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0062a108 to 127.0.0.1:53342 2023-02-12 12:03:44,948 DEBUG [Listener at localhost/32779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:44,948 DEBUG [Listener at localhost/32779] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 12:03:44,948 DEBUG [Listener at localhost/32779] util.JVMClusterUtil(257): Found active master hash=1734484820, stopped=false 2023-02-12 12:03:44,948 INFO [Listener at localhost/32779] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:44,950 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:44,950 INFO [Listener at localhost/32779] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 12:03:44,950 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:44,950 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:44,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:44,952 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:44,952 DEBUG [Listener at localhost/32779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d7311f6 to 127.0.0.1:53342 2023-02-12 12:03:44,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:44,952 DEBUG [Listener at localhost/32779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:44,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:44,952 INFO [Listener at localhost/32779] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37741,1676203422035' ***** 2023-02-12 12:03:44,953 INFO [Listener at localhost/32779] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:44,953 INFO [Listener at localhost/32779] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41705,1676203422061' ***** 2023-02-12 12:03:44,953 INFO [Listener at localhost/32779] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:44,953 INFO [RS:0;jenkins-hbase4:37741] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:44,953 INFO [RS:1;jenkins-hbase4:41705] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:44,953 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:44,953 INFO [RS:1;jenkins-hbase4:41705] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:44,953 INFO [RS:0;jenkins-hbase4:37741] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:44,954 INFO [RS:0;jenkins-hbase4:37741] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:44,954 INFO [RS:1;jenkins-hbase4:41705] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:44,954 INFO [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(3304): Received CLOSE for e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:44,954 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:44,955 INFO [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:44,955 DEBUG [RS:1;jenkins-hbase4:41705] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x754e3a3a to 127.0.0.1:53342 2023-02-12 12:03:44,955 DEBUG [RS:1;jenkins-hbase4:41705] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:44,955 INFO [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 12:03:44,956 DEBUG [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1479): Online Regions={e873bf0788f6c5d36da3b7d232795590=hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590.} 2023-02-12 12:03:44,956 DEBUG [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1505): Waiting on e873bf0788f6c5d36da3b7d232795590 2023-02-12 12:03:44,954 INFO [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:44,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e873bf0788f6c5d36da3b7d232795590, disabling compactions & flushes 2023-02-12 12:03:44,956 DEBUG [RS:0;jenkins-hbase4:37741] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44a73cb6 to 127.0.0.1:53342 2023-02-12 12:03:44,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:44,956 DEBUG [RS:0;jenkins-hbase4:37741] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:44,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:44,956 INFO [RS:0;jenkins-hbase4:37741] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:44,956 INFO [RS:0;jenkins-hbase4:37741] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:44,956 INFO [RS:0;jenkins-hbase4:37741] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:44,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. after waiting 0 ms 2023-02-12 12:03:44,956 INFO [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 12:03:44,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:44,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e873bf0788f6c5d36da3b7d232795590 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 12:03:44,956 INFO [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 12:03:44,956 DEBUG [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 12:03:44,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:44,956 DEBUG [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 12:03:44,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:44,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:44,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:44,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:44,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-12 12:03:44,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590/.tmp/info/3744041094894327ac7436158388ecb8 2023-02-12 12:03:44,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/.tmp/info/8064a7fc68ba4650bca6d604af7d35c5 2023-02-12 12:03:44,971 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8064a7fc68ba4650bca6d604af7d35c5 2023-02-12 12:03:44,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590/.tmp/info/3744041094894327ac7436158388ecb8 as hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590/info/3744041094894327ac7436158388ecb8 2023-02-12 12:03:44,972 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:44,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590/info/3744041094894327ac7436158388ecb8, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 12:03:44,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e873bf0788f6c5d36da3b7d232795590 in 21ms, sequenceid=6, compaction requested=false 2023-02-12 12:03:44,979 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:44,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/namespace/e873bf0788f6c5d36da3b7d232795590/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 12:03:44,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:44,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e873bf0788f6c5d36da3b7d232795590: Waiting for close lock at 1676203424955Running coprocessor pre-close hooks at 1676203424955Disabling compacts and flushes for region at 1676203424955Disabling writes for close at 1676203424956 (+1 ms)Obtaining lock to block concurrent updates at 1676203424956Preparing flush snapshotting stores in e873bf0788f6c5d36da3b7d232795590 at 1676203424956Finished memstore snapshotting hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676203424956Flushing stores of hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. at 1676203424957 (+1 ms)Flushing e873bf0788f6c5d36da3b7d232795590/info: creating writer at 1676203424957Flushing e873bf0788f6c5d36da3b7d232795590/info: appending metadata at 1676203424959 (+2 ms)Flushing e873bf0788f6c5d36da3b7d232795590/info: closing flushed file at 1676203424959Flushing e873bf0788f6c5d36da3b7d232795590/info: reopening flushed file at 1676203424974 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e873bf0788f6c5d36da3b7d232795590 in 21ms, sequenceid=6, compaction requested=false at 1676203424977 (+3 ms)Writing region close event to WAL at 1676203424978 (+1 ms)Running coprocessor post-close hooks at 1676203424983 (+5 ms)Closed at 1676203424983 2023-02-12 12:03:44,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676203422659.e873bf0788f6c5d36da3b7d232795590. 2023-02-12 12:03:44,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/.tmp/rep_barrier/248f8f92dcf9412caff86a25aee5e453 2023-02-12 12:03:44,987 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 248f8f92dcf9412caff86a25aee5e453 2023-02-12 12:03:44,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/.tmp/table/8af31991877c43c2af7c95b88c4df0d6 2023-02-12 12:03:44,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8af31991877c43c2af7c95b88c4df0d6 2023-02-12 12:03:44,997 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/.tmp/info/8064a7fc68ba4650bca6d604af7d35c5 as hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/info/8064a7fc68ba4650bca6d604af7d35c5 2023-02-12 12:03:45,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8064a7fc68ba4650bca6d604af7d35c5 2023-02-12 12:03:45,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/info/8064a7fc68ba4650bca6d604af7d35c5, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 12:03:45,001 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/.tmp/rep_barrier/248f8f92dcf9412caff86a25aee5e453 as hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/rep_barrier/248f8f92dcf9412caff86a25aee5e453 2023-02-12 12:03:45,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 248f8f92dcf9412caff86a25aee5e453 2023-02-12 12:03:45,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/rep_barrier/248f8f92dcf9412caff86a25aee5e453, entries=1, sequenceid=21, filesize=5.1 K 2023-02-12 12:03:45,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/.tmp/table/8af31991877c43c2af7c95b88c4df0d6 as hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/table/8af31991877c43c2af7c95b88c4df0d6 2023-02-12 12:03:45,008 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8af31991877c43c2af7c95b88c4df0d6 2023-02-12 12:03:45,008 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/table/8af31991877c43c2af7c95b88c4df0d6, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 12:03:45,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 52ms, sequenceid=21, compaction requested=false 2023-02-12 12:03:45,012 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 12:03:45,012 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:45,013 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:45,013 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203424956Running coprocessor pre-close hooks at 1676203424956Disabling compacts and flushes for region at 1676203424956Disabling writes for close at 1676203424957 (+1 ms)Obtaining lock to block concurrent updates at 1676203424957Preparing flush snapshotting stores in 1588230740 at 1676203424957Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676203424957Flushing stores of hbase:meta,,1.1588230740 at 1676203424957Flushing 1588230740/info: creating writer at 1676203424957Flushing 1588230740/info: appending metadata at 1676203424959 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676203424959Flushing 1588230740/rep_barrier: creating writer at 1676203424972 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676203424975 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676203424975Flushing 1588230740/table: creating writer at 1676203424988 (+13 ms)Flushing 1588230740/table: appending metadata at 1676203424989 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676203424989Flushing 1588230740/info: reopening flushed file at 1676203424997 (+8 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676203425001 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676203425005 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 52ms, sequenceid=21, compaction requested=false at 1676203425009 (+4 ms)Writing region close event to WAL at 1676203425009Running coprocessor post-close hooks at 1676203425012 (+3 ms)Closed at 1676203425013 (+1 ms) 2023-02-12 12:03:45,014 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:45,156 INFO [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41705,1676203422061; all regions closed. 2023-02-12 12:03:45,157 INFO [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37741,1676203422035; all regions closed. 2023-02-12 12:03:45,160 DEBUG [RS:1;jenkins-hbase4:41705] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/oldWALs 2023-02-12 12:03:45,160 INFO [RS:1;jenkins-hbase4:41705] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41705%2C1676203422061:(num 1676203423005) 2023-02-12 12:03:45,160 DEBUG [RS:1;jenkins-hbase4:41705] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:45,160 INFO [RS:1;jenkins-hbase4:41705] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:45,161 INFO [RS:1;jenkins-hbase4:41705] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:45,161 DEBUG [RS:0;jenkins-hbase4:37741] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/oldWALs 2023-02-12 12:03:45,161 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:45,161 INFO [RS:1;jenkins-hbase4:41705] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:45,161 INFO [RS:0;jenkins-hbase4:37741] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37741%2C1676203422035.meta:.meta(num 1676203422607) 2023-02-12 12:03:45,161 INFO [RS:1;jenkins-hbase4:41705] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:45,161 INFO [RS:1;jenkins-hbase4:41705] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:45,162 INFO [RS:1;jenkins-hbase4:41705] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41705 2023-02-12 12:03:45,165 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:45,165 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:45,165 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41705,1676203422061 2023-02-12 12:03:45,165 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:45,165 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:45,165 ERROR [Listener at localhost/32779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@8a21488 rejected from java.util.concurrent.ThreadPoolExecutor@c9d9144[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:45,165 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41705,1676203422061] 2023-02-12 12:03:45,165 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41705,1676203422061; numProcessing=1 2023-02-12 12:03:45,166 DEBUG [RS:0;jenkins-hbase4:37741] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/oldWALs 2023-02-12 12:03:45,166 INFO [RS:0;jenkins-hbase4:37741] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37741%2C1676203422035:(num 1676203423399) 2023-02-12 12:03:45,166 DEBUG [RS:0;jenkins-hbase4:37741] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:45,166 INFO [RS:0;jenkins-hbase4:37741] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:45,166 INFO [RS:0;jenkins-hbase4:37741] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:45,166 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:45,168 INFO [RS:0;jenkins-hbase4:37741] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37741 2023-02-12 12:03:45,168 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41705,1676203422061 already deleted, retry=false 2023-02-12 12:03:45,168 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41705,1676203422061 expired; onlineServers=1 2023-02-12 12:03:45,169 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:45,169 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37741,1676203422035 2023-02-12 12:03:45,169 ERROR [Listener at localhost/32779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5887d8d6 rejected from java.util.concurrent.ThreadPoolExecutor@5cb8571e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:45,171 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37741,1676203422035] 2023-02-12 12:03:45,171 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37741,1676203422035; numProcessing=2 2023-02-12 12:03:45,172 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37741,1676203422035 already deleted, retry=false 2023-02-12 12:03:45,172 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37741,1676203422035 expired; onlineServers=0 2023-02-12 12:03:45,172 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45697,1676203421987' ***** 2023-02-12 12:03:45,172 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 12:03:45,173 DEBUG [M:0;jenkins-hbase4:45697] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@635dab60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:45,173 INFO [M:0;jenkins-hbase4:45697] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45697,1676203421987 2023-02-12 12:03:45,173 INFO [M:0;jenkins-hbase4:45697] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45697,1676203421987; all regions closed. 2023-02-12 12:03:45,173 DEBUG [M:0;jenkins-hbase4:45697] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:45,173 DEBUG [M:0;jenkins-hbase4:45697] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 12:03:45,173 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 12:03:45,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203422251] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203422251,5,FailOnTimeoutGroup] 2023-02-12 12:03:45,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203422251] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203422251,5,FailOnTimeoutGroup] 2023-02-12 12:03:45,173 DEBUG [M:0;jenkins-hbase4:45697] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 12:03:45,174 INFO [M:0;jenkins-hbase4:45697] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 12:03:45,174 INFO [M:0;jenkins-hbase4:45697] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 12:03:45,175 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:45,175 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:45,175 INFO [M:0;jenkins-hbase4:45697] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 12:03:45,175 DEBUG [M:0;jenkins-hbase4:45697] master.HMaster(1502): Stopping service threads 2023-02-12 12:03:45,175 INFO [M:0;jenkins-hbase4:45697] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 12:03:45,175 ERROR [M:0;jenkins-hbase4:45697] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 12:03:45,175 INFO [M:0;jenkins-hbase4:45697] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 12:03:45,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:45,176 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 12:03:45,176 DEBUG [M:0;jenkins-hbase4:45697] zookeeper.ZKUtil(398): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 12:03:45,176 WARN [M:0;jenkins-hbase4:45697] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 12:03:45,176 INFO [M:0;jenkins-hbase4:45697] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 12:03:45,177 INFO [M:0;jenkins-hbase4:45697] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 12:03:45,177 DEBUG [M:0;jenkins-hbase4:45697] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:45,177 INFO [M:0;jenkins-hbase4:45697] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:45,177 DEBUG [M:0;jenkins-hbase4:45697] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:45,177 DEBUG [M:0;jenkins-hbase4:45697] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:45,177 DEBUG [M:0;jenkins-hbase4:45697] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:45,177 INFO [M:0;jenkins-hbase4:45697] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.65 KB heapSize=67.60 KB 2023-02-12 12:03:45,185 INFO [M:0;jenkins-hbase4:45697] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.65 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/412038953c6b4636969f88c1b1ed4dca 2023-02-12 12:03:45,189 DEBUG [M:0;jenkins-hbase4:45697] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/412038953c6b4636969f88c1b1ed4dca as hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/412038953c6b4636969f88c1b1ed4dca 2023-02-12 12:03:45,192 INFO [M:0;jenkins-hbase4:45697] regionserver.HStore(1080): Added hdfs://localhost:45319/user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/412038953c6b4636969f88c1b1ed4dca, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 12:03:45,193 INFO [M:0;jenkins-hbase4:45697] regionserver.HRegion(2947): Finished flush of dataSize ~56.65 KB/58008, heapSize ~67.59 KB/69208, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-12 12:03:45,193 INFO [M:0;jenkins-hbase4:45697] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:45,193 DEBUG [M:0;jenkins-hbase4:45697] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203425177Disabling compacts and flushes for region at 1676203425177Disabling writes for close at 1676203425177Obtaining lock to block concurrent updates at 1676203425177Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676203425177Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58008, getHeapSize=69208, getOffHeapSize=0, getCellsCount=145 at 1676203425177Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676203425178 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676203425178Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676203425180 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676203425180Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676203425189 (+9 ms)Finished flush of dataSize ~56.65 KB/58008, heapSize ~67.59 KB/69208, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1676203425193 (+4 ms)Writing region close event to WAL at 1676203425193Closed at 1676203425193 2023-02-12 12:03:45,196 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/af42ae50-ab5e-8cea-25a5-12308577c7d4/MasterData/WALs/jenkins-hbase4.apache.org,45697,1676203421987/jenkins-hbase4.apache.org%2C45697%2C1676203421987.1676203422182 not finished, retry = 0 2023-02-12 12:03:45,297 INFO [M:0;jenkins-hbase4:45697] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 12:03:45,297 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:45,298 INFO [M:0;jenkins-hbase4:45697] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45697 2023-02-12 12:03:45,299 DEBUG [M:0;jenkins-hbase4:45697] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45697,1676203421987 already deleted, retry=false 2023-02-12 12:03:45,454 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:45,454 INFO [M:0;jenkins-hbase4:45697] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45697,1676203421987; zookeeper connection closed. 2023-02-12 12:03:45,454 ERROR [Listener at localhost/32779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1db890c1 rejected from java.util.concurrent.ThreadPoolExecutor@198717ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:45,455 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): master:45697-0x100486a5ad50000, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:45,455 ERROR [Listener at localhost/32779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34748438 rejected from java.util.concurrent.ThreadPoolExecutor@198717ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:45,554 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:45,554 INFO [RS:0;jenkins-hbase4:37741] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37741,1676203422035; zookeeper connection closed. 2023-02-12 12:03:45,554 ERROR [Listener at localhost/32779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4ece3ef8 rejected from java.util.concurrent.ThreadPoolExecutor@5cb8571e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:45,555 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:37741-0x100486a5ad50001, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:45,555 ERROR [Listener at localhost/32779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3677bc3b rejected from java.util.concurrent.ThreadPoolExecutor@5cb8571e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:45,555 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3ed54298] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3ed54298 2023-02-12 12:03:45,655 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:45,655 INFO [RS:1;jenkins-hbase4:41705] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41705,1676203422061; zookeeper connection closed. 2023-02-12 12:03:45,655 ERROR [Listener at localhost/32779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6082f9ee rejected from java.util.concurrent.ThreadPoolExecutor@c9d9144[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:45,655 DEBUG [Listener at localhost/32779-EventThread] zookeeper.ZKWatcher(600): regionserver:41705-0x100486a5ad50002, quorum=127.0.0.1:53342, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:45,655 ERROR [Listener at localhost/32779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@186b0ec4 rejected from java.util.concurrent.ThreadPoolExecutor@c9d9144[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:45,655 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@fc81133] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@fc81133 2023-02-12 12:03:45,655 INFO [Listener at localhost/32779] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 12:03:45,655 WARN [Listener at localhost/32779] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:45,659 INFO [Listener at localhost/32779] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:45,761 WARN [BP-1239604941-172.31.14.131-1676203421417 heartbeating to localhost/127.0.0.1:45319] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:45,763 WARN [BP-1239604941-172.31.14.131-1676203421417 heartbeating to localhost/127.0.0.1:45319] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1239604941-172.31.14.131-1676203421417 (Datanode Uuid e4d6ee2f-83c0-408a-99a7-b075597d4fb5) service to localhost/127.0.0.1:45319 2023-02-12 12:03:45,764 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/cluster_2611dbbe-8ccc-905a-d076-c9b47b6c49c9/dfs/data/data3/current/BP-1239604941-172.31.14.131-1676203421417] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:45,764 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/cluster_2611dbbe-8ccc-905a-d076-c9b47b6c49c9/dfs/data/data4/current/BP-1239604941-172.31.14.131-1676203421417] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:45,765 WARN [Listener at localhost/32779] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:45,768 INFO [Listener at localhost/32779] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:45,873 WARN [BP-1239604941-172.31.14.131-1676203421417 heartbeating to localhost/127.0.0.1:45319] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:45,873 WARN [BP-1239604941-172.31.14.131-1676203421417 heartbeating to localhost/127.0.0.1:45319] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1239604941-172.31.14.131-1676203421417 (Datanode Uuid 52a73509-8428-4b46-9688-c51b21161038) service to localhost/127.0.0.1:45319 2023-02-12 12:03:45,874 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/cluster_2611dbbe-8ccc-905a-d076-c9b47b6c49c9/dfs/data/data1/current/BP-1239604941-172.31.14.131-1676203421417] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:45,874 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/cluster_2611dbbe-8ccc-905a-d076-c9b47b6c49c9/dfs/data/data2/current/BP-1239604941-172.31.14.131-1676203421417] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:45,886 INFO [Listener at localhost/32779] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:46,003 INFO [Listener at localhost/32779] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 12:03:46,017 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 12:03:46,028 INFO [Listener at localhost/32779] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=274 (was 254) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:45319 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/32779 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:45319 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:45319 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:45319 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45319 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:45319 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45697,1676203421987)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:45319 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=576 (was 652), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 296), ProcessCount=166 (was 166), AvailableMemoryMB=3931 (was 3959) 2023-02-12 12:03:46,039 INFO [Listener at localhost/32779] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=274, OpenFileDescriptor=576, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=166, AvailableMemoryMB=3930 2023-02-12 12:03:46,049 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/hadoop.log.dir so I do NOT create it in target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276 2023-02-12 12:03:46,049 WARN [Listener at localhost/32779] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 12:03:46,049 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/hadoop.tmp.dir so I do NOT create it in target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276 2023-02-12 12:03:46,049 WARN [Listener at localhost/32779] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74b76193-36e1-c985-4965-4eee6b859d5a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 12:03:46,049 DEBUG [Listener at localhost/32779] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276 2023-02-12 12:03:46,049 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 12:03:46,049 INFO [Listener at localhost/32779] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/cluster_2b7797dc-08f8-8ebb-6e1e-d987d07c2028, deleteOnExit=true 2023-02-12 12:03:46,049 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 12:03:46,050 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/test.cache.data in system properties and HBase conf 2023-02-12 12:03:46,050 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 12:03:46,050 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/hadoop.log.dir in system properties and HBase conf 2023-02-12 12:03:46,050 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 12:03:46,050 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 12:03:46,050 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 12:03:46,050 DEBUG [Listener at localhost/32779] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 12:03:46,050 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:46,050 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 12:03:46,050 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/nfs.dump.dir in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/java.io.tmpdir in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 12:03:46,051 INFO [Listener at localhost/32779] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 12:03:46,055 WARN [Listener at localhost/32779] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:46,055 WARN [Listener at localhost/32779] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:46,093 WARN [Listener at localhost/32779] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:46,094 INFO [Listener at localhost/32779] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:46,098 INFO [Listener at localhost/32779] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/java.io.tmpdir/Jetty_localhost_40405_hdfs____.aop4bd/webapp 2023-02-12 12:03:46,189 INFO [Listener at localhost/32779] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40405 2023-02-12 12:03:46,193 WARN [Listener at localhost/32779] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 12:03:46,193 WARN [Listener at localhost/32779] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 12:03:46,236 WARN [Listener at localhost/34859] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:46,250 WARN [Listener at localhost/34859] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:46,252 WARN [Listener at localhost/34859] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:46,253 INFO [Listener at localhost/34859] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:46,257 INFO [Listener at localhost/34859] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/java.io.tmpdir/Jetty_localhost_42217_datanode____3sfnup/webapp 2023-02-12 12:03:46,348 INFO [Listener at localhost/34859] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42217 2023-02-12 12:03:46,355 WARN [Listener at localhost/40189] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:46,376 WARN [Listener at localhost/40189] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 12:03:46,377 WARN [Listener at localhost/40189] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 12:03:46,379 INFO [Listener at localhost/40189] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 12:03:46,383 INFO [Listener at localhost/40189] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/java.io.tmpdir/Jetty_localhost_44431_datanode____.lvd6h3/webapp 2023-02-12 12:03:46,452 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x570da26b112947fe: Processing first storage report for DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc from datanode 741c640d-a79b-43e7-9e20-88e0db8828f5 2023-02-12 12:03:46,452 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x570da26b112947fe: from storage DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc node DatanodeRegistration(127.0.0.1:33753, datanodeUuid=741c640d-a79b-43e7-9e20-88e0db8828f5, infoPort=38413, infoSecurePort=0, ipcPort=40189, storageInfo=lv=-57;cid=testClusterID;nsid=936394332;c=1676203426058), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:46,452 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x570da26b112947fe: Processing first storage report for DS-c4f50bc4-7ba0-452a-aea3-0c5f09b43655 from datanode 741c640d-a79b-43e7-9e20-88e0db8828f5 2023-02-12 12:03:46,452 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x570da26b112947fe: from storage DS-c4f50bc4-7ba0-452a-aea3-0c5f09b43655 node DatanodeRegistration(127.0.0.1:33753, datanodeUuid=741c640d-a79b-43e7-9e20-88e0db8828f5, infoPort=38413, infoSecurePort=0, ipcPort=40189, storageInfo=lv=-57;cid=testClusterID;nsid=936394332;c=1676203426058), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:46,495 INFO [Listener at localhost/40189] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44431 2023-02-12 12:03:46,503 WARN [Listener at localhost/40947] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 12:03:46,588 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe0116595dee80bfe: Processing first storage report for DS-0aad084d-2109-407a-b9b8-11f7b62b6365 from datanode 23e5e6db-9629-4308-bfbb-f119576e1bc9 2023-02-12 12:03:46,588 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe0116595dee80bfe: from storage DS-0aad084d-2109-407a-b9b8-11f7b62b6365 node DatanodeRegistration(127.0.0.1:42943, datanodeUuid=23e5e6db-9629-4308-bfbb-f119576e1bc9, infoPort=37217, infoSecurePort=0, ipcPort=40947, storageInfo=lv=-57;cid=testClusterID;nsid=936394332;c=1676203426058), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:46,589 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe0116595dee80bfe: Processing first storage report for DS-24b9ea1e-95f7-4d73-9105-6b3849ee9dea from datanode 23e5e6db-9629-4308-bfbb-f119576e1bc9 2023-02-12 12:03:46,589 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe0116595dee80bfe: from storage DS-24b9ea1e-95f7-4d73-9105-6b3849ee9dea node DatanodeRegistration(127.0.0.1:42943, datanodeUuid=23e5e6db-9629-4308-bfbb-f119576e1bc9, infoPort=37217, infoSecurePort=0, ipcPort=40947, storageInfo=lv=-57;cid=testClusterID;nsid=936394332;c=1676203426058), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 12:03:46,609 DEBUG [Listener at localhost/40947] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276 2023-02-12 12:03:46,611 INFO [Listener at localhost/40947] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/cluster_2b7797dc-08f8-8ebb-6e1e-d987d07c2028/zookeeper_0, clientPort=63809, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/cluster_2b7797dc-08f8-8ebb-6e1e-d987d07c2028/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/cluster_2b7797dc-08f8-8ebb-6e1e-d987d07c2028/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 12:03:46,612 INFO [Listener at localhost/40947] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63809 2023-02-12 12:03:46,612 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,613 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,626 INFO [Listener at localhost/40947] util.FSUtils(479): Created version file at hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957 with version=8 2023-02-12 12:03:46,626 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,627 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,628 INFO [Listener at localhost/40947] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34859/user/jenkins/test-data/6062b3e1-e0d2-c7d7-ae1d-6e452a81c64d/hbase-staging 2023-02-12 12:03:46,630 INFO [Listener at localhost/40947] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:46,630 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:46,630 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:46,630 INFO [Listener at localhost/40947] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:46,630 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:46,630 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:46,630 INFO [Listener at localhost/40947] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:46,631 INFO [Listener at localhost/40947] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41177 2023-02-12 12:03:46,631 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,632 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,633 INFO [Listener at localhost/40947] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41177 connecting to ZooKeeper ensemble=127.0.0.1:63809 2023-02-12 12:03:46,640 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:411770x0, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:46,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41177-0x100486a6cf80000 connected 2023-02-12 12:03:46,658 DEBUG [Listener at localhost/40947] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:46,658 DEBUG [Listener at localhost/40947] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:46,659 DEBUG [Listener at localhost/40947] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:46,660 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41177 2023-02-12 12:03:46,660 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41177 2023-02-12 12:03:46,662 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41177 2023-02-12 12:03:46,662 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41177 2023-02-12 12:03:46,664 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41177 2023-02-12 12:03:46,664 INFO [Listener at localhost/40947] master.HMaster(439): hbase.rootdir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957, hbase.cluster.distributed=false 2023-02-12 12:03:46,676 INFO [Listener at localhost/40947] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:46,676 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:46,676 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:46,676 INFO [Listener at localhost/40947] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:46,676 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:46,676 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:46,676 INFO [Listener at localhost/40947] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:46,677 INFO [Listener at localhost/40947] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42137 2023-02-12 12:03:46,677 INFO [Listener at localhost/40947] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:46,680 DEBUG [Listener at localhost/40947] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:46,680 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,681 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,682 INFO [Listener at localhost/40947] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42137 connecting to ZooKeeper ensemble=127.0.0.1:63809 2023-02-12 12:03:46,684 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:421370x0, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:46,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42137-0x100486a6cf80001 connected 2023-02-12 12:03:46,686 DEBUG [Listener at localhost/40947] zookeeper.ZKUtil(164): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:46,687 DEBUG [Listener at localhost/40947] zookeeper.ZKUtil(164): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:46,688 DEBUG [Listener at localhost/40947] zookeeper.ZKUtil(164): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:46,688 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42137 2023-02-12 12:03:46,688 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42137 2023-02-12 12:03:46,690 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42137 2023-02-12 12:03:46,691 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42137 2023-02-12 12:03:46,692 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42137 2023-02-12 12:03:46,702 INFO [Listener at localhost/40947] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 12:03:46,702 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:46,703 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:46,703 INFO [Listener at localhost/40947] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 12:03:46,703 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 12:03:46,703 INFO [Listener at localhost/40947] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 12:03:46,703 INFO [Listener at localhost/40947] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 12:03:46,704 INFO [Listener at localhost/40947] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38989 2023-02-12 12:03:46,704 INFO [Listener at localhost/40947] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 12:03:46,708 DEBUG [Listener at localhost/40947] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:46,708 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,709 INFO [Listener at localhost/40947] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,710 INFO [Listener at localhost/40947] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38989 connecting to ZooKeeper ensemble=127.0.0.1:63809 2023-02-12 12:03:46,713 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:389890x0, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 12:03:46,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38989-0x100486a6cf80002 connected 2023-02-12 12:03:46,715 DEBUG [Listener at localhost/40947] zookeeper.ZKUtil(164): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:46,715 DEBUG [Listener at localhost/40947] zookeeper.ZKUtil(164): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:46,715 DEBUG [Listener at localhost/40947] zookeeper.ZKUtil(164): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 12:03:46,716 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38989 2023-02-12 12:03:46,718 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38989 2023-02-12 12:03:46,720 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38989 2023-02-12 12:03:46,720 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38989 2023-02-12 12:03:46,720 DEBUG [Listener at localhost/40947] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38989 2023-02-12 12:03:46,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:46,723 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:46,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:46,725 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:46,725 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:46,727 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:46,725 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:46,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:46,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41177,1676203426629 from backup master directory 2023-02-12 12:03:46,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 12:03:46,730 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:46,730 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 12:03:46,730 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:46,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:46,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/hbase.id with ID: 80be65b1-d0bb-4b3c-8128-2e83a566ef21 2023-02-12 12:03:46,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 12:03:46,757 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:46,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x247ab5c5 to 127.0.0.1:63809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:46,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5177f65d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:46,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:46,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 12:03:46,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:46,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/data/master/store-tmp 2023-02-12 12:03:46,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:46,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:46,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:46,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:46,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:46,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:46,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:46,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203426778Disabling compacts and flushes for region at 1676203426778Disabling writes for close at 1676203426778Writing region close event to WAL at 1676203426778Closed at 1676203426778 2023-02-12 12:03:46,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/WALs/jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:46,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41177%2C1676203426629, suffix=, logDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/WALs/jenkins-hbase4.apache.org,41177,1676203426629, archiveDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/oldWALs, maxLogs=10 2023-02-12 12:03:46,798 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33753,DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc,DISK] 2023-02-12 12:03:46,798 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42943,DS-0aad084d-2109-407a-b9b8-11f7b62b6365,DISK] 2023-02-12 12:03:46,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/WALs/jenkins-hbase4.apache.org,41177,1676203426629/jenkins-hbase4.apache.org%2C41177%2C1676203426629.1676203426780 2023-02-12 12:03:46,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33753,DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc,DISK], DatanodeInfoWithStorage[127.0.0.1:42943,DS-0aad084d-2109-407a-b9b8-11f7b62b6365,DISK]] 2023-02-12 12:03:46,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:46,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:46,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:46,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:46,803 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:46,804 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 12:03:46,805 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 12:03:46,805 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:46,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:46,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:46,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 12:03:46,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:46,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60858780, jitterRate=-0.09313350915908813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:46,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676203426800Initializing all the Stores at 1676203426801 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203426801Cleaning up temporary data from old regions at 1676203426806 (+5 ms)Cleaning up detritus from prior splits at 1676203426807 (+1 ms)Region opened successfully at 1676203426811 (+4 ms) 2023-02-12 12:03:46,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 12:03:46,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 12:03:46,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 12:03:46,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 12:03:46,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 12:03:46,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 12:03:46,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 12:03:46,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 12:03:46,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 12:03:46,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 12:03:46,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 12:03:46,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 12:03:46,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 12:03:46,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 12:03:46,829 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:46,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 12:03:46,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 12:03:46,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 12:03:46,832 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:46,832 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:46,832 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:46,832 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:46,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41177,1676203426629, sessionid=0x100486a6cf80000, setting cluster-up flag (Was=false) 2023-02-12 12:03:46,838 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:46,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 12:03:46,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:46,846 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:46,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 12:03:46,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:46,852 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.hbase-snapshot/.tmp 2023-02-12 12:03:46,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:46,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:46,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:46,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:46,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 12:03:46,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 12:03:46,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:46,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676203456855 2023-02-12 12:03:46,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 12:03:46,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 12:03:46,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 12:03:46,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 12:03:46,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 12:03:46,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 12:03:46,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,856 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:46,856 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 12:03:46,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 12:03:46,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 12:03:46,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 12:03:46,857 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:46,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 12:03:46,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 12:03:46,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203426858,5,FailOnTimeoutGroup] 2023-02-12 12:03:46,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203426858,5,FailOnTimeoutGroup] 2023-02-12 12:03:46,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 12:03:46,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,870 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:46,870 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:46,870 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957 2023-02-12 12:03:46,877 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:46,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:46,879 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/info 2023-02-12 12:03:46,880 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:46,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:46,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:46,881 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:46,881 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:46,882 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:46,882 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:46,882 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/table 2023-02-12 12:03:46,883 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:46,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:46,884 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740 2023-02-12 12:03:46,884 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740 2023-02-12 12:03:46,885 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:46,886 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:46,887 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:46,888 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74825321, jitterRate=0.1149841696023941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:46,888 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676203426877Initializing all the Stores at 1676203426878 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203426878Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203426878Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203426878Cleaning up temporary data from old regions at 1676203426885 (+7 ms)Cleaning up detritus from prior splits at 1676203426885Region opened successfully at 1676203426888 (+3 ms) 2023-02-12 12:03:46,888 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:46,888 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:46,888 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:46,888 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:46,888 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:46,888 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:46,888 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203426888Disabling compacts and flushes for region at 1676203426888Disabling writes for close at 1676203426888Writing region close event to WAL at 1676203426888Closed at 1676203426888 2023-02-12 12:03:46,889 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 12:03:46,889 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 12:03:46,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 12:03:46,890 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 12:03:46,892 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 12:03:46,922 INFO [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(952): ClusterId : 80be65b1-d0bb-4b3c-8128-2e83a566ef21 2023-02-12 12:03:46,922 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(952): ClusterId : 80be65b1-d0bb-4b3c-8128-2e83a566ef21 2023-02-12 12:03:46,923 DEBUG [RS:0;jenkins-hbase4:42137] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:46,923 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 12:03:46,925 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:46,925 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:46,925 DEBUG [RS:0;jenkins-hbase4:42137] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 12:03:46,925 DEBUG [RS:0;jenkins-hbase4:42137] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 12:03:46,928 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:46,929 DEBUG [RS:0;jenkins-hbase4:42137] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 12:03:46,929 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ReadOnlyZKClient(139): Connect 0x15431cfb to 127.0.0.1:63809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:46,930 DEBUG [RS:0;jenkins-hbase4:42137] zookeeper.ReadOnlyZKClient(139): Connect 0x23eadaab to 127.0.0.1:63809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:46,932 DEBUG [RS:1;jenkins-hbase4:38989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b84f023, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:46,932 DEBUG [RS:0;jenkins-hbase4:42137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d2d20a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:46,933 DEBUG [RS:1;jenkins-hbase4:38989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fbb778b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:46,933 DEBUG [RS:0;jenkins-hbase4:42137] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2912b1db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:46,941 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38989 2023-02-12 12:03:46,941 DEBUG [RS:0;jenkins-hbase4:42137] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42137 2023-02-12 12:03:46,941 INFO [RS:1;jenkins-hbase4:38989] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:46,941 INFO [RS:0;jenkins-hbase4:42137] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 12:03:46,941 INFO [RS:1;jenkins-hbase4:38989] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:46,941 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:46,941 INFO [RS:0;jenkins-hbase4:42137] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 12:03:46,941 DEBUG [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 12:03:46,942 INFO [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41177,1676203426629 with isa=jenkins-hbase4.apache.org/172.31.14.131:42137, startcode=1676203426675 2023-02-12 12:03:46,942 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41177,1676203426629 with isa=jenkins-hbase4.apache.org/172.31.14.131:38989, startcode=1676203426702 2023-02-12 12:03:46,942 DEBUG [RS:0;jenkins-hbase4:42137] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:46,942 DEBUG [RS:1;jenkins-hbase4:38989] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 12:03:46,943 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60233, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:46,944 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45635, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 12:03:46,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41177] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:46,945 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:46,946 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957 2023-02-12 12:03:46,946 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34859 2023-02-12 12:03:46,946 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:46,946 DEBUG [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957 2023-02-12 12:03:46,946 DEBUG [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34859 2023-02-12 12:03:46,946 DEBUG [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 12:03:46,948 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:46,952 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ZKUtil(162): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:46,952 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42137,1676203426675] 2023-02-12 12:03:46,952 WARN [RS:1;jenkins-hbase4:38989] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:46,952 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38989,1676203426702] 2023-02-12 12:03:46,952 INFO [RS:1;jenkins-hbase4:38989] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:46,952 DEBUG [RS:0;jenkins-hbase4:42137] zookeeper.ZKUtil(162): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:46,952 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/WALs/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:46,953 WARN [RS:0;jenkins-hbase4:42137] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 12:03:46,953 INFO [RS:0;jenkins-hbase4:42137] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:46,953 DEBUG [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/WALs/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:46,959 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ZKUtil(162): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:46,959 DEBUG [RS:0;jenkins-hbase4:42137] zookeeper.ZKUtil(162): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:46,960 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ZKUtil(162): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:46,960 DEBUG [RS:0;jenkins-hbase4:42137] zookeeper.ZKUtil(162): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:46,961 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:46,961 DEBUG [RS:0;jenkins-hbase4:42137] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 12:03:46,961 INFO [RS:1;jenkins-hbase4:38989] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:46,961 INFO [RS:0;jenkins-hbase4:42137] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 12:03:46,962 INFO [RS:1;jenkins-hbase4:38989] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:46,962 INFO [RS:1;jenkins-hbase4:38989] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:46,962 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,962 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:46,964 INFO [RS:0;jenkins-hbase4:42137] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 12:03:46,966 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,966 INFO [RS:0;jenkins-hbase4:42137] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 12:03:46,967 INFO [RS:0;jenkins-hbase4:42137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,967 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,967 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,967 INFO [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 12:03:46,967 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,967 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,968 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,968 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:46,968 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,968 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,968 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,968 DEBUG [RS:1;jenkins-hbase4:38989] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,969 INFO [RS:0;jenkins-hbase4:42137] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,969 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,969 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,969 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,969 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,969 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,969 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,969 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,970 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,970 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 12:03:46,970 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,970 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,970 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,970 DEBUG [RS:0;jenkins-hbase4:42137] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 12:03:46,972 INFO [RS:0;jenkins-hbase4:42137] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,972 INFO [RS:0;jenkins-hbase4:42137] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,973 INFO [RS:0;jenkins-hbase4:42137] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:46,986 INFO [RS:1;jenkins-hbase4:38989] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:46,986 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38989,1676203426702-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:47,003 INFO [RS:0;jenkins-hbase4:42137] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 12:03:47,003 INFO [RS:0;jenkins-hbase4:42137] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42137,1676203426675-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:47,004 INFO [RS:1;jenkins-hbase4:38989] regionserver.Replication(203): jenkins-hbase4.apache.org,38989,1676203426702 started 2023-02-12 12:03:47,004 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38989,1676203426702, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38989, sessionid=0x100486a6cf80002 2023-02-12 12:03:47,005 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:47,005 DEBUG [RS:1;jenkins-hbase4:38989] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:47,005 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38989,1676203426702' 2023-02-12 12:03:47,005 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:47,005 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:47,005 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:47,005 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:47,006 DEBUG [RS:1;jenkins-hbase4:38989] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:47,006 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38989,1676203426702' 2023-02-12 12:03:47,006 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:47,006 DEBUG [RS:1;jenkins-hbase4:38989] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:47,006 DEBUG [RS:1;jenkins-hbase4:38989] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:47,006 INFO [RS:1;jenkins-hbase4:38989] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:47,006 INFO [RS:1;jenkins-hbase4:38989] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:47,017 INFO [RS:0;jenkins-hbase4:42137] regionserver.Replication(203): jenkins-hbase4.apache.org,42137,1676203426675 started 2023-02-12 12:03:47,017 INFO [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42137,1676203426675, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42137, sessionid=0x100486a6cf80001 2023-02-12 12:03:47,017 DEBUG [RS:0;jenkins-hbase4:42137] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 12:03:47,017 DEBUG [RS:0;jenkins-hbase4:42137] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:47,017 DEBUG [RS:0;jenkins-hbase4:42137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42137,1676203426675' 2023-02-12 12:03:47,017 DEBUG [RS:0;jenkins-hbase4:42137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:47,017 DEBUG [RS:0;jenkins-hbase4:42137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:47,018 DEBUG [RS:0;jenkins-hbase4:42137] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 12:03:47,018 DEBUG [RS:0;jenkins-hbase4:42137] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 12:03:47,018 DEBUG [RS:0;jenkins-hbase4:42137] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:47,018 DEBUG [RS:0;jenkins-hbase4:42137] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42137,1676203426675' 2023-02-12 12:03:47,018 DEBUG [RS:0;jenkins-hbase4:42137] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:47,018 DEBUG [RS:0;jenkins-hbase4:42137] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:47,018 DEBUG [RS:0;jenkins-hbase4:42137] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 12:03:47,018 INFO [RS:0;jenkins-hbase4:42137] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 12:03:47,018 INFO [RS:0;jenkins-hbase4:42137] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 12:03:47,042 DEBUG [jenkins-hbase4:41177] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 12:03:47,042 DEBUG [jenkins-hbase4:41177] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:47,043 DEBUG [jenkins-hbase4:41177] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:47,043 DEBUG [jenkins-hbase4:41177] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:47,043 DEBUG [jenkins-hbase4:41177] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:47,044 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38989,1676203426702, state=OPENING 2023-02-12 12:03:47,045 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 12:03:47,046 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:47,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38989,1676203426702}] 2023-02-12 12:03:47,046 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:47,201 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:47,201 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 12:03:47,203 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35514, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 12:03:47,206 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 12:03:47,206 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 12:03:47,208 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38989%2C1676203426702.meta, suffix=.meta, logDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/WALs/jenkins-hbase4.apache.org,38989,1676203426702, archiveDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/oldWALs, maxLogs=32 2023-02-12 12:03:47,222 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33753,DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc,DISK] 2023-02-12 12:03:47,222 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42943,DS-0aad084d-2109-407a-b9b8-11f7b62b6365,DISK] 2023-02-12 12:03:47,224 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/WALs/jenkins-hbase4.apache.org,38989,1676203426702/jenkins-hbase4.apache.org%2C38989%2C1676203426702.meta.1676203427208.meta 2023-02-12 12:03:47,224 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33753,DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc,DISK], DatanodeInfoWithStorage[127.0.0.1:42943,DS-0aad084d-2109-407a-b9b8-11f7b62b6365,DISK]] 2023-02-12 12:03:47,224 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:47,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 12:03:47,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 12:03:47,225 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 12:03:47,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 12:03:47,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:47,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 12:03:47,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 12:03:47,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 12:03:47,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/info 2023-02-12 12:03:47,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/info 2023-02-12 12:03:47,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 12:03:47,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:47,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 12:03:47,228 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:47,228 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/rep_barrier 2023-02-12 12:03:47,229 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 12:03:47,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:47,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 12:03:47,230 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/table 2023-02-12 12:03:47,230 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/table 2023-02-12 12:03:47,230 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 12:03:47,230 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:47,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740 2023-02-12 12:03:47,232 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740 2023-02-12 12:03:47,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 12:03:47,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 12:03:47,234 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58945025, jitterRate=-0.12165068089962006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 12:03:47,234 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676203427225Writing region info on filesystem at 1676203427225Initializing all the Stores at 1676203427226 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203427226Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203427226Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203427226Cleaning up temporary data from old regions at 1676203427232 (+6 ms)Cleaning up detritus from prior splits at 1676203427232Running coprocessor post-open hooks at 1676203427234 (+2 ms)Region opened successfully at 1676203427234 2023-02-12 12:03:47,235 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676203427201 2023-02-12 12:03:47,238 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 12:03:47,240 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 12:03:47,240 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38989,1676203426702, state=OPEN 2023-02-12 12:03:47,241 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 12:03:47,242 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 12:03:47,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 12:03:47,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38989,1676203426702 in 196 msec 2023-02-12 12:03:47,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 12:03:47,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-12 12:03:47,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 392 msec 2023-02-12 12:03:47,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676203426723, completionTime=-1 2023-02-12 12:03:47,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 12:03:47,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 12:03:47,248 DEBUG [hconnection-0x2d5660fa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:47,249 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35526, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:47,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 12:03:47,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676203487250 2023-02-12 12:03:47,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676203547250 2023-02-12 12:03:47,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-12 12:03:47,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41177,1676203426629-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:47,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41177,1676203426629-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:47,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41177,1676203426629-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:47,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41177, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:47,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 12:03:47,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 12:03:47,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:47,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 12:03:47,260 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 12:03:47,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:47,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:47,262 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:47,263 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a empty. 2023-02-12 12:03:47,263 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:47,263 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 12:03:47,270 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:47,271 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 38a2545ee9f932e74ee2bc44db93817a, NAME => 'hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp 2023-02-12 12:03:47,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:47,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 38a2545ee9f932e74ee2bc44db93817a, disabling compactions & flushes 2023-02-12 12:03:47,282 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:47,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:47,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. after waiting 0 ms 2023-02-12 12:03:47,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:47,282 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:47,282 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 38a2545ee9f932e74ee2bc44db93817a: Waiting for close lock at 1676203427282Disabling compacts and flushes for region at 1676203427282Disabling writes for close at 1676203427282Writing region close event to WAL at 1676203427282Closed at 1676203427282 2023-02-12 12:03:47,284 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:47,285 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203427285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203427285"}]},"ts":"1676203427285"} 2023-02-12 12:03:47,286 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:47,287 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:47,287 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203427287"}]},"ts":"1676203427287"} 2023-02-12 12:03:47,288 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 12:03:47,290 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:47,291 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:47,291 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:47,291 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:47,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=38a2545ee9f932e74ee2bc44db93817a, ASSIGN}] 2023-02-12 12:03:47,294 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=38a2545ee9f932e74ee2bc44db93817a, ASSIGN 2023-02-12 12:03:47,294 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=38a2545ee9f932e74ee2bc44db93817a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1676203426702; forceNewPlan=false, retain=false 2023-02-12 12:03:47,444 INFO [jenkins-hbase4:41177] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:47,445 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=38a2545ee9f932e74ee2bc44db93817a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:47,445 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203427445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203427445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203427445"}]},"ts":"1676203427445"} 2023-02-12 12:03:47,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 38a2545ee9f932e74ee2bc44db93817a, server=jenkins-hbase4.apache.org,38989,1676203426702}] 2023-02-12 12:03:47,601 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:47,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38989%2C1676203426702, suffix=, logDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/WALs/jenkins-hbase4.apache.org,38989,1676203426702, archiveDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/oldWALs, maxLogs=32 2023-02-12 12:03:47,615 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42943,DS-0aad084d-2109-407a-b9b8-11f7b62b6365,DISK] 2023-02-12 12:03:47,615 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33753,DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc,DISK] 2023-02-12 12:03:47,617 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/WALs/jenkins-hbase4.apache.org,38989,1676203426702/jenkins-hbase4.apache.org%2C38989%2C1676203426702.1676203427602 2023-02-12 12:03:47,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33753,DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc,DISK], DatanodeInfoWithStorage[127.0.0.1:42943,DS-0aad084d-2109-407a-b9b8-11f7b62b6365,DISK]] 2023-02-12 12:03:47,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 38a2545ee9f932e74ee2bc44db93817a, NAME => 'hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:47,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:47,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:47,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:47,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:47,618 INFO [StoreOpener-38a2545ee9f932e74ee2bc44db93817a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:47,619 DEBUG [StoreOpener-38a2545ee9f932e74ee2bc44db93817a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a/info 2023-02-12 12:03:47,619 DEBUG [StoreOpener-38a2545ee9f932e74ee2bc44db93817a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a/info 2023-02-12 12:03:47,620 INFO [StoreOpener-38a2545ee9f932e74ee2bc44db93817a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38a2545ee9f932e74ee2bc44db93817a columnFamilyName info 2023-02-12 12:03:47,620 INFO [StoreOpener-38a2545ee9f932e74ee2bc44db93817a-1] regionserver.HStore(310): Store=38a2545ee9f932e74ee2bc44db93817a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:47,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:47,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:47,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:47,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:47,624 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 38a2545ee9f932e74ee2bc44db93817a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63978423, jitterRate=-0.04664720594882965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 12:03:47,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 38a2545ee9f932e74ee2bc44db93817a: Running coprocessor pre-open hook at 1676203427617Writing region info on filesystem at 1676203427617Initializing all the Stores at 1676203427618 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676203427618Cleaning up temporary data from old regions at 1676203427621 (+3 ms)Cleaning up detritus from prior splits at 1676203427621Running coprocessor post-open hooks at 1676203427624 (+3 ms)Region opened successfully at 1676203427624 2023-02-12 12:03:47,625 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a., pid=6, masterSystemTime=1676203427598 2023-02-12 12:03:47,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:47,627 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:47,628 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=38a2545ee9f932e74ee2bc44db93817a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:47,628 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676203427627"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203427627"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203427627"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203427627"}]},"ts":"1676203427627"} 2023-02-12 12:03:47,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 12:03:47,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 38a2545ee9f932e74ee2bc44db93817a, server=jenkins-hbase4.apache.org,38989,1676203426702 in 183 msec 2023-02-12 12:03:47,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 12:03:47,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=38a2545ee9f932e74ee2bc44db93817a, ASSIGN in 339 msec 2023-02-12 12:03:47,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:47,632 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203427632"}]},"ts":"1676203427632"} 2023-02-12 12:03:47,633 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 12:03:47,636 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:47,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 377 msec 2023-02-12 12:03:47,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 12:03:47,662 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:47,662 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:47,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 12:03:47,671 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:47,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-12 12:03:47,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 12:03:47,683 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 12:03:47,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 12:03:47,689 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 12:03:47,692 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 12:03:47,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.962sec 2023-02-12 12:03:47,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 12:03:47,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 12:03:47,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 12:03:47,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41177,1676203426629-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 12:03:47,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41177,1676203426629-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 12:03:47,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 12:03:47,723 DEBUG [Listener at localhost/40947] zookeeper.ReadOnlyZKClient(139): Connect 0x1934e044 to 127.0.0.1:63809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:47,726 DEBUG [Listener at localhost/40947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4529a32d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:47,727 DEBUG [hconnection-0x7e8330c7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:47,728 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35530, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:47,730 INFO [Listener at localhost/40947] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:47,730 DEBUG [Listener at localhost/40947] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 12:03:47,732 DEBUG [Listener at localhost/40947] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 12:03:47,733 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48980, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 12:03:47,734 INFO [Listener at localhost/40947] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 12:03:47,734 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 12:03:47,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 12:03:47,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:48980 deadline: 1676203487734, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 12:03:47,735 INFO [Listener at localhost/40947] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 12:03:47,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 12:03:47,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 12:03:47,739 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 12:03:47,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 12:03:47,740 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 12:03:47,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:47,741 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:47,741 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265 empty. 2023-02-12 12:03:47,742 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:47,742 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 12:03:47,749 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 12:03:47,750 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 91f0b4df5b1b3b835542f4986bde3265, NAME => 'testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp 2023-02-12 12:03:47,756 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:47,756 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 91f0b4df5b1b3b835542f4986bde3265, disabling compactions & flushes 2023-02-12 12:03:47,756 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:47,756 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:47,756 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. after waiting 0 ms 2023-02-12 12:03:47,756 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:47,756 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:47,756 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 91f0b4df5b1b3b835542f4986bde3265: Waiting for close lock at 1676203427756Disabling compacts and flushes for region at 1676203427756Disabling writes for close at 1676203427756Writing region close event to WAL at 1676203427756Closed at 1676203427756 2023-02-12 12:03:47,758 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 12:03:47,758 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676203427758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203427758"}]},"ts":"1676203427758"} 2023-02-12 12:03:47,759 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 12:03:47,760 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 12:03:47,760 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203427760"}]},"ts":"1676203427760"} 2023-02-12 12:03:47,761 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 12:03:47,769 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 12:03:47,770 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 12:03:47,770 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 12:03:47,770 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 12:03:47,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=91f0b4df5b1b3b835542f4986bde3265, ASSIGN}] 2023-02-12 12:03:47,772 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=91f0b4df5b1b3b835542f4986bde3265, ASSIGN 2023-02-12 12:03:47,773 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=91f0b4df5b1b3b835542f4986bde3265, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38989,1676203426702; forceNewPlan=false, retain=false 2023-02-12 12:03:47,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:47,923 INFO [jenkins-hbase4:41177] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 12:03:47,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=91f0b4df5b1b3b835542f4986bde3265, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:47,924 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676203427923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203427923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203427923"}]},"ts":"1676203427923"} 2023-02-12 12:03:47,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 91f0b4df5b1b3b835542f4986bde3265, server=jenkins-hbase4.apache.org,38989,1676203426702}] 2023-02-12 12:03:48,020 INFO [RS:0;jenkins-hbase4:42137] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42137%2C1676203426675, suffix=, logDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/WALs/jenkins-hbase4.apache.org,42137,1676203426675, archiveDir=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/oldWALs, maxLogs=32 2023-02-12 12:03:48,035 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33753,DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc,DISK] 2023-02-12 12:03:48,035 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42943,DS-0aad084d-2109-407a-b9b8-11f7b62b6365,DISK] 2023-02-12 12:03:48,037 INFO [RS:0;jenkins-hbase4:42137] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/WALs/jenkins-hbase4.apache.org,42137,1676203426675/jenkins-hbase4.apache.org%2C42137%2C1676203426675.1676203428020 2023-02-12 12:03:48,037 DEBUG [RS:0;jenkins-hbase4:42137] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42943,DS-0aad084d-2109-407a-b9b8-11f7b62b6365,DISK], DatanodeInfoWithStorage[127.0.0.1:33753,DS-953423d6-60ab-40ae-af50-6e9d9d10a6dc,DISK]] 2023-02-12 12:03:48,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:48,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:48,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 91f0b4df5b1b3b835542f4986bde3265, NAME => 'testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.', STARTKEY => '', ENDKEY => ''} 2023-02-12 12:03:48,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:48,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:48,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:48,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:48,081 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:48,082 DEBUG [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1 2023-02-12 12:03:48,082 DEBUG [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1 2023-02-12 12:03:48,082 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91f0b4df5b1b3b835542f4986bde3265 columnFamilyName f1 2023-02-12 12:03:48,083 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(310): Store=91f0b4df5b1b3b835542f4986bde3265/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:48,083 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:48,084 DEBUG [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2 2023-02-12 12:03:48,084 DEBUG [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2 2023-02-12 12:03:48,084 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91f0b4df5b1b3b835542f4986bde3265 columnFamilyName f2 2023-02-12 12:03:48,084 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(310): Store=91f0b4df5b1b3b835542f4986bde3265/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:48,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:48,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:48,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:48,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:48,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 12:03:48,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 91f0b4df5b1b3b835542f4986bde3265; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68501136, jitterRate=0.020746469497680664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:48,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 91f0b4df5b1b3b835542f4986bde3265: Running coprocessor pre-open hook at 1676203428080Writing region info on filesystem at 1676203428080Initializing all the Stores at 1676203428081 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203428081Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203428081Cleaning up temporary data from old regions at 1676203428085 (+4 ms)Cleaning up detritus from prior splits at 1676203428086 (+1 ms)Running coprocessor post-open hooks at 1676203428089 (+3 ms)Region opened successfully at 1676203428089 2023-02-12 12:03:48,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265., pid=12, masterSystemTime=1676203428077 2023-02-12 12:03:48,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:48,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:48,091 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=91f0b4df5b1b3b835542f4986bde3265, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,091 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676203428091"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676203428091"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676203428091"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676203428091"}]},"ts":"1676203428091"} 2023-02-12 12:03:48,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 12:03:48,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 91f0b4df5b1b3b835542f4986bde3265, server=jenkins-hbase4.apache.org,38989,1676203426702 in 168 msec 2023-02-12 12:03:48,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 12:03:48,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=91f0b4df5b1b3b835542f4986bde3265, ASSIGN in 324 msec 2023-02-12 12:03:48,097 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 12:03:48,097 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203428097"}]},"ts":"1676203428097"} 2023-02-12 12:03:48,098 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 12:03:48,100 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 12:03:48,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 363 msec 2023-02-12 12:03:48,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 12:03:48,344 INFO [Listener at localhost/40947] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 12:03:48,344 DEBUG [Listener at localhost/40947] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 12:03:48,344 INFO [Listener at localhost/40947] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:48,346 INFO [Listener at localhost/40947] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 12:03:48,346 INFO [Listener at localhost/40947] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 12:03:48,347 INFO [Listener at localhost/40947] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 12:03:48,347 INFO [Listener at localhost/40947] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 12:03:48,441 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38989] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:48,520 INFO [Listener at localhost/40947] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 12:03:48,521 INFO [Listener at localhost/40947] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 12:03:48,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 12:03:48,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676203428522 (current time:1676203428522). 2023-02-12 12:03:48,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 12:03:48,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] zookeeper.ReadOnlyZKClient(139): Connect 0x006eefcf to 127.0.0.1:63809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 12:03:48,522 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 12:03:48,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d5088d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 12:03:48,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 12:03:48,530 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35538, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 12:03:48,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x006eefcf to 127.0.0.1:63809 2023-02-12 12:03:48,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:48,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 12:03:48,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 12:03:48,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 12:03:48,534 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 12:03:48,534 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676204028534 2023-02-12 12:03:48,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 12:03:48,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 12:03:48,535 DEBUG [Listener at localhost/40947] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:48,536 DEBUG [Listener at localhost/40947] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 12:03:48,538 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 12:03:48,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 12:03:48,540 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-12 12:03:48,541 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 12:03:48,542 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676204028542 2023-02-12 12:03:48,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-12 12:03:48,570 INFO [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-12 12:03:48,570 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:48,571 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-12 12:03:48,571 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 12:03:48,572 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,572 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 12:03:48,574 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:48,574 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:48,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:48,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:48,574 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:48,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:48,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 12:03:48,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 12:03:48,574 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,574 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:48,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 12:03:48,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 12:03:48,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 12:03:48,575 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 12:03:48,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 12:03:48,575 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 12:03:48,575 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 12:03:48,575 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 12:03:48,576 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 12:03:48,576 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:48,577 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 12:03:48,577 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 12:03:48,577 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42137,1676203426675' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 12:03:48,577 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 12:03:48,577 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 12:03:48,582 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 12:03:48,582 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 12:03:48,582 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1676203426702' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 12:03:48,583 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,584 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:48,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:48,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,585 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:48,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:48,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:48,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 12:03:48,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:48,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:48,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1676203426702' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-12 12:03:48,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@164b6062[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:48,587 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 12:03:48,587 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,589 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,589 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,589 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,589 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:48,589 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 12:03:48,589 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 12:03:48,590 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 12:03:48,590 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42137,1676203426675' in zk 2023-02-12 12:03:48,590 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 12:03:48,590 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 12:03:48,590 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:48,590 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. started... 2023-02-12 12:03:48,590 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 91f0b4df5b1b3b835542f4986bde3265 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 12:03:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 12:03:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:48,592 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 12:03:48,611 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/.tmp/f1/fed57734d9f34f11b71768e3bdf25336 2023-02-12 12:03:48,628 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/.tmp/f2/d31ab5c1d1fd46af9400c779e5905b8e 2023-02-12 12:03:48,633 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/.tmp/f1/fed57734d9f34f11b71768e3bdf25336 as hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/fed57734d9f34f11b71768e3bdf25336 2023-02-12 12:03:48,636 DEBUG [Listener at localhost/40947] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:48,636 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/fed57734d9f34f11b71768e3bdf25336, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 12:03:48,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:48,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 12:03:48,637 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/.tmp/f2/d31ab5c1d1fd46af9400c779e5905b8e as hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/d31ab5c1d1fd46af9400c779e5905b8e 2023-02-12 12:03:48,637 DEBUG [Listener at localhost/40947] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 12:03:48,641 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/d31ab5c1d1fd46af9400c779e5905b8e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 12:03:48,641 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 91f0b4df5b1b3b835542f4986bde3265 in 51ms, sequenceid=5, compaction requested=false 2023-02-12 12:03:48,641 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 12:03:48,642 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 91f0b4df5b1b3b835542f4986bde3265: 2023-02-12 12:03:48,642 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-12 12:03:48,642 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 12:03:48,642 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/fed57734d9f34f11b71768e3bdf25336] hfiles 2023-02-12 12:03:48,642 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/fed57734d9f34f11b71768e3bdf25336 for snapshot=testWithMapReduceSingleRegion 2023-02-12 12:03:48,642 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/d31ab5c1d1fd46af9400c779e5905b8e] hfiles 2023-02-12 12:03:48,642 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/d31ab5c1d1fd46af9400c779e5905b8e for snapshot=testWithMapReduceSingleRegion 2023-02-12 12:03:48,658 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. completed. 2023-02-12 12:03:48,658 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:48,658 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 12:03:48,658 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 12:03:48,658 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,658 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 12:03:48,659 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38989,1676203426702' in zk 2023-02-12 12:03:48,660 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,660 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 12:03:48,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,660 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:48,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:48,660 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 12:03:48,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 12:03:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:48,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:48,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 12:03:48,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:48,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38989,1676203426702': 2023-02-12 12:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1676203426702' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 12:03:48,666 INFO [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-12 12:03:48,666 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:48,666 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:48,666 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-12 12:03:48,666 INFO [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 12:03:48,669 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,669 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 12:03:48,669 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:48,669 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,670 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:48,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:48,670 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:48,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 12:03:48,670 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 12:03:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,672 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:48,672 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 12:03:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,680 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:48,680 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 12:03:48,680 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,680 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-12 12:03:48,680 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 12:03:48,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-12 12:03:48,680 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:48,680 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:48,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:48,680 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:48,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 12:03:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:48,680 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 12:03:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 12:03:48,680 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 12:03:48,681 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,681 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,681 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:48,681 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 12:03:48,681 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 12:03:48,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:48,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 12:03:48,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 12:03:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 12:03:48,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-12 12:03:48,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-12 12:03:48,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 12:03:48,727 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 12:03:48,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676203428535Consolidate snapshot: testWithMapReduceSingleRegion at 1676203428680 (+145 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676203428680Writing data manifest for testWithMapReduceSingleRegion at 1676203428683 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676203428696 (+13 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676203428726 (+30 ms) 2023-02-12 12:03:48,728 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 12:03:48,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 193 msec 2023-02-12 12:03:48,837 DEBUG [Listener at localhost/40947] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 12:03:48,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 12:03:48,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 12:03:48,839 INFO [Listener at localhost/40947] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 12:03:48,842 INFO [Listener at localhost/40947] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 12:03:48,846 INFO [Listener at localhost/40947] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 12:03:48,877 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38989] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:48,955 INFO [Listener at localhost/40947] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 12:03:48,960 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 12:03:48,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 12:03:48,962 INFO [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 12:03:48,962 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:48,962 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 12:03:48,962 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 12:03:48,962 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:48,962 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:48,963 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:48,964 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,964 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:48,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:48,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:48,964 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:48,964 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 12:03:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:48,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:48,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:48,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 12:03:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:48,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:48,965 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 12:03:48,965 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 12:03:48,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 12:03:48,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 12:03:48,965 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:48,965 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. started... 2023-02-12 12:03:48,965 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42137,1676203426675' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 12:03:48,966 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 91f0b4df5b1b3b835542f4986bde3265 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 12:03:48,967 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:48,967 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:48,967 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:48,981 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/.tmp/f1/7a1ef53acae14bcf918cc54b8febe827 2023-02-12 12:03:48,998 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/.tmp/f2/6a2ecbf3b6064d0abdfde65087377b0c 2023-02-12 12:03:49,002 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/.tmp/f1/7a1ef53acae14bcf918cc54b8febe827 as hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/7a1ef53acae14bcf918cc54b8febe827 2023-02-12 12:03:49,005 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/7a1ef53acae14bcf918cc54b8febe827, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 12:03:49,006 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/.tmp/f2/6a2ecbf3b6064d0abdfde65087377b0c as hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/6a2ecbf3b6064d0abdfde65087377b0c 2023-02-12 12:03:49,009 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/6a2ecbf3b6064d0abdfde65087377b0c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 12:03:49,010 INFO [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 91f0b4df5b1b3b835542f4986bde3265 in 44ms, sequenceid=9, compaction requested=false 2023-02-12 12:03:49,010 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 91f0b4df5b1b3b835542f4986bde3265: 2023-02-12 12:03:49,010 DEBUG [rs(jenkins-hbase4.apache.org,38989,1676203426702)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:49,010 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 12:03:49,010 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 12:03:49,010 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,010 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 12:03:49,010 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38989,1676203426702' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 12:03:49,012 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,012 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:49,012 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,012 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 12:03:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:49,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:49,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38989,1676203426702' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 12:03:49,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1274f673[Count = 0] remaining members to acquire global barrier 2023-02-12 12:03:49,014 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 12:03:49,014 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,015 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,015 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,015 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 12:03:49,015 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 12:03:49,016 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 12:03:49,016 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 12:03:49,016 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42137,1676203426675' in zk 2023-02-12 12:03:49,016 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,016 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 12:03:49,016 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38989,1676203426702' in zk 2023-02-12 12:03:49,017 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 12:03:49,017 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,017 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:49,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:49,017 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 12:03:49,017 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:49,017 DEBUG [member: 'jenkins-hbase4.apache.org,42137,1676203426675' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 12:03:49,018 DEBUG [member: 'jenkins-hbase4.apache.org,38989,1676203426702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 12:03:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:49,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:49,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38989,1676203426702': 2023-02-12 12:03:49,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38989,1676203426702' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 12:03:49,020 INFO [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 12:03:49,020 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 12:03:49,020 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 12:03:49,020 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 12:03:49,020 INFO [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 12:03:49,022 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,022 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,022 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:49,022 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,022 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:49,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 12:03:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 12:03:49,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,022 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:49,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 12:03:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:49,023 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 12:03:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:49,024 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:49,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,024 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 12:03:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 12:03:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:49,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,027 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,027 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:49,027 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:49,027 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 12:03:49,027 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:49,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:49,027 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:49,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:49,027 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 12:03:49,028 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 12:03:49,027 DEBUG [(jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 12:03:49,027 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 12:03:49,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 12:03:49,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:49,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:49,027 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 12:03:49,028 DEBUG [Listener at localhost/40947] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 12:03:49,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 12:03:49,028 DEBUG [Listener at localhost/40947] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 12:03:49,028 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:49,028 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,028 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:49,028 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 12:03:49,028 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 12:03:49,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 12:03:49,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 12:03:49,128 DEBUG [Listener at localhost/40947] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 12:03:49,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 12:03:49,215 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/hadoop-5508853683330661299.jar 2023-02-12 12:03:49,218 INFO [Listener at localhost/40947] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676203428522 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:49,219 DEBUG [Listener at localhost/40947] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34859/user/jenkins/test-data/6062b3e1-e0d2-c7d7-ae1d-6e452a81c64d/testWithMapReduceSingleRegion/e9ddc9d4-23fe-4ce5-a801-69d45fccebd0/data/default/testWithMapReduce 2023-02-12 12:03:49,219 INFO [Listener at localhost/40947] snapshot.RestoreSnapshotHelper(239): region to add: 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:49,219 INFO [Listener at localhost/40947] snapshot.RestoreSnapshotHelper(585): clone region=91f0b4df5b1b3b835542f4986bde3265 as 91f0b4df5b1b3b835542f4986bde3265 in snapshot testWithMapReduceSingleRegion 2023-02-12 12:03:49,220 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 91f0b4df5b1b3b835542f4986bde3265, NAME => 'testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34859/user/jenkins/test-data/6062b3e1-e0d2-c7d7-ae1d-6e452a81c64d/testWithMapReduceSingleRegion/e9ddc9d4-23fe-4ce5-a801-69d45fccebd0 2023-02-12 12:03:49,231 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:49,231 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fed57734d9f34f11b71768e3bdf25336 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 12:03:49,233 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d31ab5c1d1fd46af9400c779e5905b8e from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 12:03:49,235 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 91f0b4df5b1b3b835542f4986bde3265, disabling compactions & flushes 2023-02-12 12:03:49,235 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:49,235 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:49,235 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. after waiting 0 ms 2023-02-12 12:03:49,235 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:49,235 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:49,235 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 91f0b4df5b1b3b835542f4986bde3265: Waiting for close lock at 1676203429235Disabling compacts and flushes for region at 1676203429235Disabling writes for close at 1676203429235Writing region close event to WAL at 1676203429235Closed at 1676203429235 2023-02-12 12:03:49,235 INFO [Listener at localhost/40947] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676203428522 type: FLUSH version: 2 ttl: 0 2023-02-12 12:03:49,236 DEBUG [Listener at localhost/40947] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34859/user/jenkins/test-data/6062b3e1-e0d2-c7d7-ae1d-6e452a81c64d/testWithMapReduceSingleRegion/e9ddc9d4-23fe-4ce5-a801-69d45fccebd0 2023-02-12 12:03:49,236 DEBUG [Listener at localhost/40947] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34859/user/jenkins/test-data/6062b3e1-e0d2-c7d7-ae1d-6e452a81c64d/testWithMapReduceSingleRegion/e9ddc9d4-23fe-4ce5-a801-69d45fccebd0 2023-02-12 12:03:49,236 DEBUG [Listener at localhost/40947] util.CommonFSUtils(699): |-data/ 2023-02-12 12:03:49,236 DEBUG [Listener at localhost/40947] util.CommonFSUtils(699): |----default/ 2023-02-12 12:03:49,237 DEBUG [Listener at localhost/40947] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 12:03:49,237 DEBUG [Listener at localhost/40947] util.CommonFSUtils(699): |----------91f0b4df5b1b3b835542f4986bde3265/ 2023-02-12 12:03:49,237 DEBUG [Listener at localhost/40947] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 12:03:49,237 DEBUG [Listener at localhost/40947] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 12:03:49,238 DEBUG [Listener at localhost/40947] util.CommonFSUtils(702): |----------------testWithMapReduce=91f0b4df5b1b3b835542f4986bde3265-fed57734d9f34f11b71768e3bdf25336 2023-02-12 12:03:49,238 DEBUG [Listener at localhost/40947] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 12:03:49,238 DEBUG [Listener at localhost/40947] util.CommonFSUtils(702): |----------------testWithMapReduce=91f0b4df5b1b3b835542f4986bde3265-d31ab5c1d1fd46af9400c779e5905b8e 2023-02-12 12:03:49,238 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,239 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,239 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,239 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,240 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,240 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,240 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,310 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/hadoop-8647111017277448222.jar 2023-02-12 12:03:49,310 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,310 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,311 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,311 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,311 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,311 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,312 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 12:03:49,312 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 12:03:49,313 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 12:03:49,313 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 12:03:49,313 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 12:03:49,314 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 12:03:49,314 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 12:03:49,314 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 12:03:49,315 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 12:03:49,315 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 12:03:49,316 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 12:03:49,317 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 12:03:49,317 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 12:03:49,318 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 12:03:49,318 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 12:03:49,385 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/hadoop-7059594748168265404.jar 2023-02-12 12:03:49,386 DEBUG [Listener at localhost/40947] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 12:03:49,391 WARN [Listener at localhost/40947] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 12:03:49,422 INFO [Listener at localhost/40947] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 12:03:49,496 WARN [Listener at localhost/40947] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/mapreduce.cluster.local.dir/1676203429462/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 12:03:49,497 WARN [Listener at localhost/40947] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/mapreduce.cluster.local.dir/1676203429462/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 12:03:49,539 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 12:03:49,539 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 12:03:49,539 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 12:03:49,541 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:49,542 DEBUG [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/6062b3e1-e0d2-c7d7-ae1d-6e452a81c64d/testWithMapReduceSingleRegion/e9ddc9d4-23fe-4ce5-a801-69d45fccebd0/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1 2023-02-12 12:03:49,542 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91f0b4df5b1b3b835542f4986bde3265 columnFamilyName f1 2023-02-12 12:03:49,546 DEBUG [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(539): loaded hdfs://localhost:34859/user/jenkins/test-data/6062b3e1-e0d2-c7d7-ae1d-6e452a81c64d/testWithMapReduceSingleRegion/e9ddc9d4-23fe-4ce5-a801-69d45fccebd0/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/testWithMapReduce=91f0b4df5b1b3b835542f4986bde3265-fed57734d9f34f11b71768e3bdf25336 2023-02-12 12:03:49,546 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(310): Store=91f0b4df5b1b3b835542f4986bde3265/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:49,546 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:49,547 DEBUG [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34859/user/jenkins/test-data/6062b3e1-e0d2-c7d7-ae1d-6e452a81c64d/testWithMapReduceSingleRegion/e9ddc9d4-23fe-4ce5-a801-69d45fccebd0/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2 2023-02-12 12:03:49,548 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91f0b4df5b1b3b835542f4986bde3265 columnFamilyName f2 2023-02-12 12:03:49,551 DEBUG [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(539): loaded hdfs://localhost:34859/user/jenkins/test-data/6062b3e1-e0d2-c7d7-ae1d-6e452a81c64d/testWithMapReduceSingleRegion/e9ddc9d4-23fe-4ce5-a801-69d45fccebd0/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/testWithMapReduce=91f0b4df5b1b3b835542f4986bde3265-d31ab5c1d1fd46af9400c779e5905b8e 2023-02-12 12:03:49,551 INFO [StoreOpener-91f0b4df5b1b3b835542f4986bde3265-1] regionserver.HStore(310): Store=91f0b4df5b1b3b835542f4986bde3265/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 12:03:49,551 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 12:03:49,551 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 91f0b4df5b1b3b835542f4986bde3265; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75246587, jitterRate=0.12126152217388153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 12:03:49,552 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 91f0b4df5b1b3b835542f4986bde3265: Writing region info on filesystem at 1676203429540Initializing all the Stores at 1676203429540Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203429540Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676203429541 (+1 ms)Region opened successfully at 1676203429552 (+11 ms) 2023-02-12 12:03:49,663 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 91f0b4df5b1b3b835542f4986bde3265, disabling compactions & flushes 2023-02-12 12:03:49,663 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:49,663 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:49,663 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. after waiting 0 ms 2023-02-12 12:03:49,663 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:49,664 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:49,664 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 91f0b4df5b1b3b835542f4986bde3265: Waiting for close lock at 1676203429663Disabling compacts and flushes for region at 1676203429663Disabling writes for close at 1676203429663Writing region close event to WAL at 1676203429664 (+1 ms)Closed at 1676203429664 2023-02-12 12:03:50,471 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:50,471 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 12:03:50,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-12 12:03:50,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-12 12:03:50,545 INFO [Listener at localhost/40947] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 12:03:50,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 12:03:50,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 12:03:50,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:50,548 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203430548"}]},"ts":"1676203430548"} 2023-02-12 12:03:50,549 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 12:03:50,551 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 12:03:50,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=91f0b4df5b1b3b835542f4986bde3265, UNASSIGN}] 2023-02-12 12:03:50,552 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=91f0b4df5b1b3b835542f4986bde3265, UNASSIGN 2023-02-12 12:03:50,552 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=91f0b4df5b1b3b835542f4986bde3265, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:50,552 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676203430552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676203430552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676203430552"}]},"ts":"1676203430552"} 2023-02-12 12:03:50,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 91f0b4df5b1b3b835542f4986bde3265, server=jenkins-hbase4.apache.org,38989,1676203426702}] 2023-02-12 12:03:50,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:50,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:50,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 91f0b4df5b1b3b835542f4986bde3265, disabling compactions & flushes 2023-02-12 12:03:50,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:50,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:50,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. after waiting 0 ms 2023-02-12 12:03:50,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:50,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 12:03:50,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265. 2023-02-12 12:03:50,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 91f0b4df5b1b3b835542f4986bde3265: Waiting for close lock at 1676203430705Running coprocessor pre-close hooks at 1676203430705Disabling compacts and flushes for region at 1676203430705Disabling writes for close at 1676203430705Writing region close event to WAL at 1676203430706 (+1 ms)Running coprocessor post-close hooks at 1676203430709 (+3 ms)Closed at 1676203430710 (+1 ms) 2023-02-12 12:03:50,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:50,712 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=91f0b4df5b1b3b835542f4986bde3265, regionState=CLOSED 2023-02-12 12:03:50,712 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676203430712"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676203430712"}]},"ts":"1676203430712"} 2023-02-12 12:03:50,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 12:03:50,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 91f0b4df5b1b3b835542f4986bde3265, server=jenkins-hbase4.apache.org,38989,1676203426702 in 160 msec 2023-02-12 12:03:50,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 12:03:50,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=91f0b4df5b1b3b835542f4986bde3265, UNASSIGN in 164 msec 2023-02-12 12:03:50,717 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676203430717"}]},"ts":"1676203430717"} 2023-02-12 12:03:50,718 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 12:03:50,720 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 12:03:50,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 175 msec 2023-02-12 12:03:50,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 12:03:50,851 INFO [Listener at localhost/40947] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-12 12:03:50,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-12 12:03:50,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:50,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:50,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:50,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 12:03:50,858 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:50,859 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2, FileablePath, hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/recovered.edits] 2023-02-12 12:03:50,862 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/7a1ef53acae14bcf918cc54b8febe827 to hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/archive/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/7a1ef53acae14bcf918cc54b8febe827 2023-02-12 12:03:50,863 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/fed57734d9f34f11b71768e3bdf25336 to hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/archive/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f1/fed57734d9f34f11b71768e3bdf25336 2023-02-12 12:03:50,865 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/6a2ecbf3b6064d0abdfde65087377b0c to hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/archive/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/6a2ecbf3b6064d0abdfde65087377b0c 2023-02-12 12:03:50,866 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/d31ab5c1d1fd46af9400c779e5905b8e to hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/archive/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/f2/d31ab5c1d1fd46af9400c779e5905b8e 2023-02-12 12:03:50,868 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/recovered.edits/12.seqid to hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/archive/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265/recovered.edits/12.seqid 2023-02-12 12:03:50,868 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/.tmp/data/default/testWithMapReduce/91f0b4df5b1b3b835542f4986bde3265 2023-02-12 12:03:50,868 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 12:03:50,870 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:50,872 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-12 12:03:50,873 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 12:03:50,874 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:50,874 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 12:03:50,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676203430874"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:50,875 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 12:03:50,875 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 91f0b4df5b1b3b835542f4986bde3265, NAME => 'testWithMapReduce,,1676203427737.91f0b4df5b1b3b835542f4986bde3265.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 12:03:50,875 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 12:03:50,875 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676203430875"}]},"ts":"9223372036854775807"} 2023-02-12 12:03:50,876 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 12:03:50,877 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 12:03:50,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 27 msec 2023-02-12 12:03:50,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41177] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 12:03:50,956 INFO [Listener at localhost/40947] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-12 12:03:50,956 INFO [Listener at localhost/40947] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 12:03:50,957 INFO [Listener at localhost/40947] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 12:03:50,957 DEBUG [Listener at localhost/40947] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1934e044 to 127.0.0.1:63809 2023-02-12 12:03:50,957 DEBUG [Listener at localhost/40947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:50,957 DEBUG [Listener at localhost/40947] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 12:03:50,957 DEBUG [Listener at localhost/40947] util.JVMClusterUtil(257): Found active master hash=1026602539, stopped=false 2023-02-12 12:03:50,957 INFO [Listener at localhost/40947] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:50,960 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:50,960 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:50,960 INFO [Listener at localhost/40947] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 12:03:50,960 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 12:03:50,960 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:50,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:50,962 DEBUG [Listener at localhost/40947] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x247ab5c5 to 127.0.0.1:63809 2023-02-12 12:03:50,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:50,963 DEBUG [Listener at localhost/40947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:50,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 12:03:50,963 INFO [Listener at localhost/40947] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42137,1676203426675' ***** 2023-02-12 12:03:50,963 INFO [Listener at localhost/40947] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:50,963 INFO [Listener at localhost/40947] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38989,1676203426702' ***** 2023-02-12 12:03:50,963 INFO [Listener at localhost/40947] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 12:03:50,963 INFO [RS:0;jenkins-hbase4:42137] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:50,963 INFO [RS:1;jenkins-hbase4:38989] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 12:03:50,963 INFO [RS:0;jenkins-hbase4:42137] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:50,963 INFO [RS:1;jenkins-hbase4:38989] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 12:03:50,963 INFO [RS:0;jenkins-hbase4:42137] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:50,963 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:50,963 INFO [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:50,963 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 12:03:50,964 DEBUG [RS:0;jenkins-hbase4:42137] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23eadaab to 127.0.0.1:63809 2023-02-12 12:03:50,965 DEBUG [RS:0;jenkins-hbase4:42137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:50,965 INFO [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42137,1676203426675; all regions closed. 2023-02-12 12:03:50,963 INFO [RS:1;jenkins-hbase4:38989] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 12:03:50,965 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(3304): Received CLOSE for 38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:50,965 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:50,965 DEBUG [RS:1;jenkins-hbase4:38989] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15431cfb to 127.0.0.1:63809 2023-02-12 12:03:50,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 38a2545ee9f932e74ee2bc44db93817a, disabling compactions & flushes 2023-02-12 12:03:50,965 DEBUG [RS:1;jenkins-hbase4:38989] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:50,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:50,965 INFO [RS:1;jenkins-hbase4:38989] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:50,965 INFO [RS:1;jenkins-hbase4:38989] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:50,965 INFO [RS:1;jenkins-hbase4:38989] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:50,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:50,966 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 12:03:50,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. after waiting 0 ms 2023-02-12 12:03:50,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:50,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 38a2545ee9f932e74ee2bc44db93817a 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 12:03:50,966 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 12:03:50,966 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 38a2545ee9f932e74ee2bc44db93817a=hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a.} 2023-02-12 12:03:50,966 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 12:03:50,966 DEBUG [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1505): Waiting on 1588230740, 38a2545ee9f932e74ee2bc44db93817a 2023-02-12 12:03:50,966 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 12:03:50,966 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 12:03:50,966 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 12:03:50,966 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 12:03:50,966 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-12 12:03:50,968 DEBUG [RS:0;jenkins-hbase4:42137] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/oldWALs 2023-02-12 12:03:50,969 INFO [RS:0;jenkins-hbase4:42137] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42137%2C1676203426675:(num 1676203428020) 2023-02-12 12:03:50,969 DEBUG [RS:0;jenkins-hbase4:42137] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:50,969 INFO [RS:0;jenkins-hbase4:42137] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:50,969 INFO [RS:0;jenkins-hbase4:42137] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:50,969 INFO [RS:0;jenkins-hbase4:42137] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 12:03:50,969 INFO [RS:0;jenkins-hbase4:42137] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 12:03:50,969 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:50,969 INFO [RS:0;jenkins-hbase4:42137] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 12:03:50,969 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 12:03:50,970 INFO [RS:0;jenkins-hbase4:42137] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42137 2023-02-12 12:03:50,970 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 12:03:50,972 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:50,972 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:50,972 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42137,1676203426675 2023-02-12 12:03:50,972 ERROR [Listener at localhost/40947-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58d35fb5 rejected from java.util.concurrent.ThreadPoolExecutor@5cecd077[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:50,972 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:50,972 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:50,972 ERROR [Listener at localhost/40947-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a511937 rejected from java.util.concurrent.ThreadPoolExecutor@5cecd077[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:50,973 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42137,1676203426675] 2023-02-12 12:03:50,973 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42137,1676203426675; numProcessing=1 2023-02-12 12:03:50,974 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42137,1676203426675 already deleted, retry=false 2023-02-12 12:03:50,974 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42137,1676203426675 expired; onlineServers=1 2023-02-12 12:03:50,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/.tmp/info/842729e9c8cd4a008bf6d5cb1c1f784a 2023-02-12 12:03:50,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a/.tmp/info/9deb92e9c2e340af922036eebe2be797 2023-02-12 12:03:50,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 842729e9c8cd4a008bf6d5cb1c1f784a 2023-02-12 12:03:50,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a/.tmp/info/9deb92e9c2e340af922036eebe2be797 as hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a/info/9deb92e9c2e340af922036eebe2be797 2023-02-12 12:03:50,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a/info/9deb92e9c2e340af922036eebe2be797, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 12:03:50,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 38a2545ee9f932e74ee2bc44db93817a in 21ms, sequenceid=6, compaction requested=false 2023-02-12 12:03:50,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/.tmp/rep_barrier/95d2405d671c4a6cb9213bca5629abbe 2023-02-12 12:03:50,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/namespace/38a2545ee9f932e74ee2bc44db93817a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 12:03:50,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:50,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 38a2545ee9f932e74ee2bc44db93817a: Waiting for close lock at 1676203430965Running coprocessor pre-close hooks at 1676203430965Disabling compacts and flushes for region at 1676203430965Disabling writes for close at 1676203430966 (+1 ms)Obtaining lock to block concurrent updates at 1676203430966Preparing flush snapshotting stores in 38a2545ee9f932e74ee2bc44db93817a at 1676203430966Finished memstore snapshotting hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676203430966Flushing stores of hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. at 1676203430967 (+1 ms)Flushing 38a2545ee9f932e74ee2bc44db93817a/info: creating writer at 1676203430967Flushing 38a2545ee9f932e74ee2bc44db93817a/info: appending metadata at 1676203430969 (+2 ms)Flushing 38a2545ee9f932e74ee2bc44db93817a/info: closing flushed file at 1676203430969Flushing 38a2545ee9f932e74ee2bc44db93817a/info: reopening flushed file at 1676203430983 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 38a2545ee9f932e74ee2bc44db93817a in 21ms, sequenceid=6, compaction requested=false at 1676203430987 (+4 ms)Writing region close event to WAL at 1676203430987Running coprocessor post-close hooks at 1676203430991 (+4 ms)Closed at 1676203430992 (+1 ms) 2023-02-12 12:03:50,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676203427259.38a2545ee9f932e74ee2bc44db93817a. 2023-02-12 12:03:50,992 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95d2405d671c4a6cb9213bca5629abbe 2023-02-12 12:03:51,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/.tmp/table/9594be1a40a94c0381904818bd9cb643 2023-02-12 12:03:51,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9594be1a40a94c0381904818bd9cb643 2023-02-12 12:03:51,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/.tmp/info/842729e9c8cd4a008bf6d5cb1c1f784a as hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/info/842729e9c8cd4a008bf6d5cb1c1f784a 2023-02-12 12:03:51,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 842729e9c8cd4a008bf6d5cb1c1f784a 2023-02-12 12:03:51,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/info/842729e9c8cd4a008bf6d5cb1c1f784a, entries=12, sequenceid=21, filesize=6.2 K 2023-02-12 12:03:51,010 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/.tmp/rep_barrier/95d2405d671c4a6cb9213bca5629abbe as hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/rep_barrier/95d2405d671c4a6cb9213bca5629abbe 2023-02-12 12:03:51,013 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95d2405d671c4a6cb9213bca5629abbe 2023-02-12 12:03:51,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/rep_barrier/95d2405d671c4a6cb9213bca5629abbe, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 12:03:51,014 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/.tmp/table/9594be1a40a94c0381904818bd9cb643 as hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/table/9594be1a40a94c0381904818bd9cb643 2023-02-12 12:03:51,017 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:51,017 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:51,019 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9594be1a40a94c0381904818bd9cb643 2023-02-12 12:03:51,019 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/table/9594be1a40a94c0381904818bd9cb643, entries=4, sequenceid=21, filesize=5.0 K 2023-02-12 12:03:51,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=21, compaction requested=false 2023-02-12 12:03:51,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 12:03:51,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 12:03:51,025 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:51,025 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676203430966Running coprocessor pre-close hooks at 1676203430966Disabling compacts and flushes for region at 1676203430966Disabling writes for close at 1676203430966Obtaining lock to block concurrent updates at 1676203430966Preparing flush snapshotting stores in 1588230740 at 1676203430966Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676203430966Flushing stores of hbase:meta,,1.1588230740 at 1676203430967 (+1 ms)Flushing 1588230740/info: creating writer at 1676203430967Flushing 1588230740/info: appending metadata at 1676203430969 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676203430969Flushing 1588230740/rep_barrier: creating writer at 1676203430981 (+12 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676203430983 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676203430983Flushing 1588230740/table: creating writer at 1676203430993 (+10 ms)Flushing 1588230740/table: appending metadata at 1676203430994 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676203430994Flushing 1588230740/info: reopening flushed file at 1676203431006 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676203431011 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676203431015 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=21, compaction requested=false at 1676203431020 (+5 ms)Writing region close event to WAL at 1676203431021 (+1 ms)Running coprocessor post-close hooks at 1676203431023 (+2 ms)Closed at 1676203431025 (+2 ms) 2023-02-12 12:03:51,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 12:03:51,159 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:51,160 INFO [RS:0;jenkins-hbase4:42137] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42137,1676203426675; zookeeper connection closed. 2023-02-12 12:03:51,160 ERROR [Listener at localhost/40947-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12e8df37 rejected from java.util.concurrent.ThreadPoolExecutor@5cecd077[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:51,160 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:42137-0x100486a6cf80001, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:51,160 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@8ea043c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@8ea043c 2023-02-12 12:03:51,160 ERROR [Listener at localhost/40947-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bbb8c6f rejected from java.util.concurrent.ThreadPoolExecutor@5cecd077[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:51,166 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38989,1676203426702; all regions closed. 2023-02-12 12:03:51,171 DEBUG [RS:1;jenkins-hbase4:38989] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/oldWALs 2023-02-12 12:03:51,171 INFO [RS:1;jenkins-hbase4:38989] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38989%2C1676203426702.meta:.meta(num 1676203427208) 2023-02-12 12:03:51,174 DEBUG [RS:1;jenkins-hbase4:38989] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/oldWALs 2023-02-12 12:03:51,175 INFO [RS:1;jenkins-hbase4:38989] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38989%2C1676203426702:(num 1676203427602) 2023-02-12 12:03:51,175 DEBUG [RS:1;jenkins-hbase4:38989] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:51,175 INFO [RS:1;jenkins-hbase4:38989] regionserver.LeaseManager(133): Closed leases 2023-02-12 12:03:51,175 INFO [RS:1;jenkins-hbase4:38989] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 12:03:51,175 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:51,177 INFO [RS:1;jenkins-hbase4:38989] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38989 2023-02-12 12:03:51,180 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38989,1676203426702 2023-02-12 12:03:51,180 ERROR [Listener at localhost/40947-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@547b1952 rejected from java.util.concurrent.ThreadPoolExecutor@50448705[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:51,180 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 12:03:51,181 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38989,1676203426702] 2023-02-12 12:03:51,181 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38989,1676203426702; numProcessing=2 2023-02-12 12:03:51,182 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38989,1676203426702 already deleted, retry=false 2023-02-12 12:03:51,182 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38989,1676203426702 expired; onlineServers=0 2023-02-12 12:03:51,182 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41177,1676203426629' ***** 2023-02-12 12:03:51,182 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 12:03:51,183 DEBUG [M:0;jenkins-hbase4:41177] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@390f2555, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 12:03:51,183 INFO [M:0;jenkins-hbase4:41177] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41177,1676203426629 2023-02-12 12:03:51,183 INFO [M:0;jenkins-hbase4:41177] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41177,1676203426629; all regions closed. 2023-02-12 12:03:51,183 DEBUG [M:0;jenkins-hbase4:41177] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 12:03:51,183 DEBUG [M:0;jenkins-hbase4:41177] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 12:03:51,183 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 12:03:51,183 DEBUG [M:0;jenkins-hbase4:41177] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 12:03:51,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203426858] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676203426858,5,FailOnTimeoutGroup] 2023-02-12 12:03:51,183 INFO [M:0;jenkins-hbase4:41177] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 12:03:51,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203426858] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676203426858,5,FailOnTimeoutGroup] 2023-02-12 12:03:51,184 INFO [M:0;jenkins-hbase4:41177] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 12:03:51,184 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 12:03:51,184 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 12:03:51,185 INFO [M:0;jenkins-hbase4:41177] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 12:03:51,185 DEBUG [M:0;jenkins-hbase4:41177] master.HMaster(1502): Stopping service threads 2023-02-12 12:03:51,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 12:03:51,185 INFO [M:0;jenkins-hbase4:41177] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 12:03:51,185 ERROR [M:0;jenkins-hbase4:41177] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 12:03:51,185 INFO [M:0;jenkins-hbase4:41177] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 12:03:51,186 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 12:03:51,186 DEBUG [M:0;jenkins-hbase4:41177] zookeeper.ZKUtil(398): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 12:03:51,186 WARN [M:0;jenkins-hbase4:41177] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 12:03:51,186 INFO [M:0;jenkins-hbase4:41177] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 12:03:51,186 INFO [M:0;jenkins-hbase4:41177] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 12:03:51,187 DEBUG [M:0;jenkins-hbase4:41177] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 12:03:51,187 INFO [M:0;jenkins-hbase4:41177] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:51,187 DEBUG [M:0;jenkins-hbase4:41177] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:51,187 DEBUG [M:0;jenkins-hbase4:41177] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 12:03:51,187 DEBUG [M:0;jenkins-hbase4:41177] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:51,187 INFO [M:0;jenkins-hbase4:41177] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.67 KB heapSize=65.63 KB 2023-02-12 12:03:51,197 INFO [M:0;jenkins-hbase4:41177] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2e32952133264efa9f0fbaa60a0ab70b 2023-02-12 12:03:51,201 DEBUG [M:0;jenkins-hbase4:41177] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2e32952133264efa9f0fbaa60a0ab70b as hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2e32952133264efa9f0fbaa60a0ab70b 2023-02-12 12:03:51,205 INFO [M:0;jenkins-hbase4:41177] regionserver.HStore(1080): Added hdfs://localhost:34859/user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2e32952133264efa9f0fbaa60a0ab70b, entries=17, sequenceid=132, filesize=8.6 K 2023-02-12 12:03:51,205 INFO [M:0;jenkins-hbase4:41177] regionserver.HRegion(2947): Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-12 12:03:51,206 INFO [M:0;jenkins-hbase4:41177] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 12:03:51,206 DEBUG [M:0;jenkins-hbase4:41177] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676203431187Disabling compacts and flushes for region at 1676203431187Disabling writes for close at 1676203431187Obtaining lock to block concurrent updates at 1676203431187Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676203431187Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55987, getHeapSize=67184, getOffHeapSize=0, getCellsCount=145 at 1676203431187Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676203431188 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676203431188Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676203431190 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676203431190Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676203431202 (+12 ms)Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676203431205 (+3 ms)Writing region close event to WAL at 1676203431206 (+1 ms)Closed at 1676203431206 2023-02-12 12:03:51,208 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/44acec7f-1411-2d12-1e3d-83e771c4a957/MasterData/WALs/jenkins-hbase4.apache.org,41177,1676203426629/jenkins-hbase4.apache.org%2C41177%2C1676203426629.1676203426780 not finished, retry = 0 2023-02-12 12:03:51,309 INFO [M:0;jenkins-hbase4:41177] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 12:03:51,309 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 12:03:51,309 INFO [M:0;jenkins-hbase4:41177] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41177 2023-02-12 12:03:51,312 DEBUG [M:0;jenkins-hbase4:41177] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41177,1676203426629 already deleted, retry=false 2023-02-12 12:03:51,561 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:51,561 INFO [M:0;jenkins-hbase4:41177] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41177,1676203426629; zookeeper connection closed. 2023-02-12 12:03:51,561 ERROR [Listener at localhost/40947-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50b21edd rejected from java.util.concurrent.ThreadPoolExecutor@548d9013[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:51,562 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): master:41177-0x100486a6cf80000, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:51,562 ERROR [Listener at localhost/40947-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60505b57 rejected from java.util.concurrent.ThreadPoolExecutor@548d9013[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:51,661 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:51,661 INFO [RS:1;jenkins-hbase4:38989] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38989,1676203426702; zookeeper connection closed. 2023-02-12 12:03:51,661 ERROR [Listener at localhost/40947-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28249af0 rejected from java.util.concurrent.ThreadPoolExecutor@50448705[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:51,661 DEBUG [Listener at localhost/40947-EventThread] zookeeper.ZKWatcher(600): regionserver:38989-0x100486a6cf80002, quorum=127.0.0.1:63809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 12:03:51,661 ERROR [Listener at localhost/40947-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50117016 rejected from java.util.concurrent.ThreadPoolExecutor@50448705[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 12:03:51,661 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f7a3cf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f7a3cf 2023-02-12 12:03:51,661 INFO [Listener at localhost/40947] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 12:03:51,662 WARN [Listener at localhost/40947] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:51,666 INFO [Listener at localhost/40947] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:51,767 WARN [BP-471353329-172.31.14.131-1676203426058 heartbeating to localhost/127.0.0.1:34859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:51,767 WARN [BP-471353329-172.31.14.131-1676203426058 heartbeating to localhost/127.0.0.1:34859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-471353329-172.31.14.131-1676203426058 (Datanode Uuid 23e5e6db-9629-4308-bfbb-f119576e1bc9) service to localhost/127.0.0.1:34859 2023-02-12 12:03:51,768 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/cluster_2b7797dc-08f8-8ebb-6e1e-d987d07c2028/dfs/data/data3/current/BP-471353329-172.31.14.131-1676203426058] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:51,768 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/cluster_2b7797dc-08f8-8ebb-6e1e-d987d07c2028/dfs/data/data4/current/BP-471353329-172.31.14.131-1676203426058] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:51,770 WARN [Listener at localhost/40947] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 12:03:51,774 INFO [Listener at localhost/40947] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:51,875 WARN [BP-471353329-172.31.14.131-1676203426058 heartbeating to localhost/127.0.0.1:34859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 12:03:51,875 WARN [BP-471353329-172.31.14.131-1676203426058 heartbeating to localhost/127.0.0.1:34859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-471353329-172.31.14.131-1676203426058 (Datanode Uuid 741c640d-a79b-43e7-9e20-88e0db8828f5) service to localhost/127.0.0.1:34859 2023-02-12 12:03:51,876 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/cluster_2b7797dc-08f8-8ebb-6e1e-d987d07c2028/dfs/data/data1/current/BP-471353329-172.31.14.131-1676203426058] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:51,876 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/da623e41-fed6-2e50-5c4e-ea9acb926276/cluster_2b7797dc-08f8-8ebb-6e1e-d987d07c2028/dfs/data/data2/current/BP-471353329-172.31.14.131-1676203426058] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 12:03:51,885 INFO [Listener at localhost/40947] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 12:03:51,998 INFO [Listener at localhost/40947] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 12:03:52,019 INFO [Listener at localhost/40947] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 12:03:52,031 INFO [Listener at localhost/40947] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=294 (was 274) Potentially hanging thread: (jenkins-hbase4.apache.org,41177,1676203426629)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40947 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34859 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34859 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:34859 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34859 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34859 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:34859 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (854894358) connection to localhost/127.0.0.1:34859 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=605 (was 576) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=298 (was 280) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=3836 (was 3930)